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Method and Apparatus for Generating 3D Models from Medical Images 

r.npyripht Notice 

A portion of the disclosure of this patent document contains material which 
is subject to copyright protection. The copyright owner has no objection to the 
5 facsimile reproduction by any one of the patent disclosure, as it appears in the 
Patent and Trademark Office patent files or records, but otherwise reserves all 
copyright rights whatsoever. 

The Field of the Invention 
This invention relates to the field of medical imaging. In particular, the 
10 invention relates to the generation and use of three-dimensional medical images 
and models. 

Background nf the Invention 
Efforts to represent images in three-dimensional form go back to the 
invention of the stereoscope in the 1800's. These attempts continued through 
15 the 1950's when 3-D movies (characterized by the red and blue 3-D glasses 
which served as color filters to separate left and right images) were briefly 
popular. With the advent of modern computer technology, some companies 
have engaged in considerable efforts to capture and reproduce three-dimensional 
information. 

20 Typically, three-dimensional information about a scene has been represented 

using a number of selected points and storing information about each point such 
as its color, intensity and distance from the camera. For example, a Cyberware 

-1 - 

SUBSTITUTE SHEET (RULE 26) 



BNSDOCID: <WO 8959106A1_I_> 



WO 99/59106 PCT/US99/10566 
scanner generates such information by rotating a camera around an object to be 
modeled and capturing that information at particular points. For a high 
resolution model, many rotations about the object are required to capture the 
model information. The vertical displacement of the plane of rotation is 
5 decremented by a resolution amount after each rotation. Such models, while 
accurate, result in a huge number of points at which information must be 
captured and represented. 

Some portions of objects, however, do not require such high resolution. As 
a result, model builders will frequently manually remove unneeded vertices to 

10 simplify the processing required when displaying and manipulating a three- 
dimensional model. 

Such three-dimensional models are typically rendered as wire frames. That 
is, a plurality of points are identified, corresponding to the points at which image 
information is captured and the points are displayed together with lines 

15 connecting each point with adjacent points. When models are displayed in this 
manner, they are typically called wireframes because the lines between the points 
appear to constitute a wire mesh. The individual points in such a wireframe are 
frequently called vertices because they frequently appear at the vertex of the 
angles formed by lines going to adjacent points. 

20 Software is known for constructing and manipulating three-dimensional 

models. An example of such software is 3-D Studio Max™ by Autodesk, Inc. 
Typically, such software packages have the capability to render, or provide a 
surface texture over the surface of the wireframe model. 

-2- 
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A number of attempts have been made to standardize the representation of 
three-dimensional information. Of current popularity is the Virtual Reality 
Mark-up Language (VRML) found with some frequency in an Internet context. 
Wireframe models are commercially available from a variety of sources. 
5 In the medical area, magnetic resonance imaging (MRI), and other imaging 

technologies, can accurately display two-dimensional slices of a patient. The 
slices include extremely large amounts of data. Some programs allow doctors to 
construct 3-D models from these 2-D images. But this process requires a large 
amount of data processing. The resulting 3-D models are accurate in that they 
10 describe exactly what is in the images, but the models do not have any tie to 

human anatomy. For example, an irregular shape in a 3-D model of a skull may 
be a tumor, but the system does not relate this additional information to the 
shape. Even worse, the 3-D model does not even have information indicating 
that the shape is within a skull. The doctor is responsible for making these 
15 determinations. Thus, the 3-D models have hmited use. Another problem with 
many of these systems is that they do not allow the doctor to build the model 
using combined or a range of imaging technologies (e.g., x-rays, MRIs and 
photographs). Thus, the models are typically defined using only one imaging 
technology. 

20 A number of problems exist with the existing technology. First, a high 

degree of technical expertise is required to create and manipulate threer 
dimensional models. Further, computer processing time is significant and, as a 
result, special purpose machines, such as those produced by Silicon Graphics, 
Inc. are commonly used to generate and manipulate three-dimensional models. 
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The user interfaces of available commercial software for dealing with three- 
dimensional models are highly technical and generally unsuited for use by a 
person whose specialty is not in the computer sciences. Also, the 3-D models do 
not are not related to medical information about a patient (e.g., a shape in a 3-D 

5 model is only a shape, there is no information that the shape is a tumor or body 
part). Also, some technologies do not allow doctors to build models from 
different types of images (e.g., x-rays, MRI's, and photographs). 

Therefore what is desired is an improved 3-D modeling and generation 
system. 
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Summary of the Invention 
The following summarizes various embodiments of the invention. 
One aspect of the invention is directed to providing a generic software tool 
for creating and manipulating three-dimensional models for medical applications. 
5 In one embodiment, a number of modules are used to achieve this result. 

These modules include a Sculptor module, a Clinician module and an Executor 
module. 

The Sculptor module maps all acquired imaging, including those from 
disparate sources, into a single 3D matrix or database. The images are generated 

10 using a number of different techniques, such as optical and x-ray. The Sculptor 
allows a user to identify the location of different anatomical points in each of the 
images. Thus, the Sculptor allows a user to relate different anatomical points to 
each other in a 3-D space and also relate the points to the images. 

The Clinician/Consultant module uses the related points to modify or 

15 customize a stock model (e.g., a standard anatomical 3-D model). The 

customized model that is created corresponds to a 3-D model of the patient's 
anatomy. The model is "smart" in that when certain changes are made to the dot 
or vertex location of the model, the remainder of the model can be adjusted or 
morphed to make corresponding changes. Additionally, objects in the model 

20 know what part of the anatomy they represent. For example, an object 

representing the patient's tooth is associated with data indicating that the object 
is a tooth. This allows for analysis of a patient's anatomy to be performed 
automatically. The CUnician/Consultant is a database query tool that allows for 

-5- 
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display or visualization of the anatomy and function, manipulation of objects for 
treatment planning and model analyses. 

A third module, called the Executor, is a database that provides overall 
system file and image management and coordinates the Sculptor module and the 
5 CUnician/Consultant modules. 

The various features of the invention are illustrated in the context of an 
application to Orthodontics. In this application, the stock model is a model of 
the skull and associated facial soft tissues, including the upper and lower jaws. 
In the examples shown, this model has approximately 300 objects which can be 
10 manipulated in the Clinician module to facilitate the kinds of tasks routinely 
undertaken by an orthodontist. 

Some embodiments of the invention include the functionality of some or all 
of the above modules. For example, in some embodiments, only a subset of the 
functions performed by the Sculptor are included (e.g., the ability to define 
1 5 related points in multiple images). 

Other embodiments of the invention include a method and apparatus for 
performing medical analysis of the patient's 3-D model. 

Although many details have been included in the description and the figures, 
the invention is defined by the scope of the claims. Only limitations found in 
20 those claims apply to the invention. 
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Brief Description of the Drawings 
The figures illustrate the invention by way of example, and not limitation. 
Like references indicate similar elements. 

Figure 1 illustrates a computer system including one embodiment of the 
5 invention. 

Figure 2 illustrates an architecture of the software used in one embodiment 
of the invention. 

Figure 3 illustrates capturing images for use in the system. 

Figure 4 and Figure 5 illustrates the calibration frame. 
10 Figure 6 illustrates an example method calibrating images, generating a 

patient specific model, and performing analysis from the calibrated images and 
the patient specific model. 

Figure 7 through Figure 24 illustrates user interfaces for a sculpture 
application. 

15 Figure 25 through Figure 40 illustrates user interfaces for a clinician 

application. 

The Description 

Definitions 

The following definitions will be helpful in understanding the description. 
20 Computer - is any computing device (e.g., PC compatible computer, Unix 

workstation, handheld device etc.). Generally, a computer includes a processor 
and a memory. A computer can include a network of computers. 
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Handheld Device (or Palmtop Computer)- a computer with a smaller form 
factor than a desktop computer or a laptop computer. Examples of a handheld 
device include the Palm III™ handheld computer and Microsoft's palm sized 
computers. 

5 User - any end user who would normally wish to retrieve information from 

the World Wide Web. 

Internet - is a collection of information stored in computers physically 
located throughout the world. Much of the information on the Internet is 
organized onto electronic pages. Users typically bring one page to their 
10 computer screen, discover its contents, and have the option of bringing more 
pages of information. 

Client - a computer used by the user to make a query. 
Server - a computer that supplies information in response to a query, or 
performs intermediary tasks between a client and another server. 
15 World Wide Web (or Web or web) - is one aspect of the Internet that 

supports client and server computers handling multimedia pages. Clients use 
software, such as the Netscape Communicator® browser, to view pages. Server 
computers use server software to maintain pages for clients to access. 

Program - a sequence of instructions that can be executed by a computer. A 
20 program can include other programs. A program can include only one 
instruction. 

Application - is a program. 

The detailed descriptions which follow may be presented in terms of program 
procedures executed on a computer or network of computers. These procedural 

-8- 
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descriptions and representations are the means used by those skilled in the art to 
most effectively convey the substance of their work to others skilled in the art. 

A procedure, program or application, is here, and generally, conceived to be 
a self-consistent sequence of steps leading to a desired result. These steps are 
5 those requiring physical manipulations of physical quantities. Usually, though 
not necessarily, these quantities take the form of electrical or magnetic signals 
capable of being stored, transferred, combined, compared, and otherwise 
manipulated. It proves convenient at times, principally for reasons of common 
usage, to refer to these signals as bits, values, elements, symbols, characters, 
10 terms, numbers, or the like. It should be noted, however, that all of these and 

similar terms are to be associated with the appropriate physical quantities and are 
merely convenient labels applied to these quantities. 

Further, the manipulations performed are often referred to in terms, such as 
adding or comparing, which are commonly associated with mental operations 
15 performed by a human operator. No such capability of a human operator is 
necessary, or desirable in most cases, in any of the operations described herein 
which form part of the present invention; the operations are machine operations. 
Useful machines for performing the operation of the present invention include 
general purpose digital computers or similar devices. 
20 The present invention also relates to apparatus for performing these 

operations. This apparatus may be specially constructed for the required 
purpose or it may comprise a general purpose computer as selectively activated 
or reconfigured by a computer program stored in the computer. The procedures 
• presented herein are not inherently related to a particular computer or other 

-9 - 
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apparatus. Various general purpose machines may be used with programs 

written in accordance with the teachings herein, or it may prove more convenient 

to construct more specialized apparatus to perform the required method steps. 

The required structure for a variety of these machines will appear from the 

5 description given. 

System 

Figure 1 illustrates a computer 110 that can be used to carry out the 
invention. The following paragraphs first list the elements of Figure 1, then 
describe how they are connected, and then define those elements. 

10 Figure 1 includes a computer 1 10, a sculptor 1 15, a clinician/consultant 125, 

and an executor 135. The sculptor 1 15 includes a display of a user interface 
having a number of patient images 150 that also show a calibration frame 140. 
The clinician/consultant 125 includes a similar user interface that includes a a 
view of a patient specific model 160 and an analysis window 127. The analysis 

15 window 127 includes an example analysis 170. The executor 135 includes image 
data 137 and patient model data 139. 

This paragraph describes how the elements of Figure 1 are connected. The 
sculptor 115 and clinician/consultant 125 communicate with the executor 135. 
The sculptor 115 and the clinician/consultant 125 can extract and manipulate 

20 information from the image data 137 and the patient model data 139 through the 
executor 135. 
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The following paragraphs describe the elements of Figure 1 in greater detail. 
How these elements are used to generate a 3D model of a patient's anatomy is 
describe in relation to Figure 2. 

The computer 1 10 represents a computer system upon which the 
5 sculptor 1 15, the clinician/consultant 125, and the executor 135 can execute. 
The computer 1 1 0 is representative of a standard personal computer such as is 
available from Dell Computers, Inc. Of course any number of different types of 
computers could be used as the computer 1 10. What is important is that the 
computer 1 1 0 some sort of processor and some memory. 
10 As an alternative to the system of Figure 1 , the sculptor 1 1 5 and the 

executor 135 may run on one computer at one time. While at another time, the 
clinician/consultant 125 and the executor 135 can run on another computer at 
another time. Alternatively, all three programs can run on different computers. 
The computers can be linked together by a network such as the Internet. 
15 The sculptor 1 1 5 represents a computer program in which a number of 

different types of patient images 150 can be calibrated using the images of the 
calibration frame 140. Note that the patient images 1 50 are from multiple 
sources. In particular, in this example, an x-ray image and two photographs are 
shown. The sculptor 1 15 allows a technician to calibrate the images and identify 
20 a number of anatomical locations in the images. 

The patient images 1 50 can be extracted from the image data 137. The 
image data 137 can be imported from an external source either by transmission 
over a network or by scanning of x-ray or optical images, for example. Other 
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embodiments can include direct capture of x-ray images or other types of media 

images. 

Alternatively, the image data 137 need not be retrieved from the 
executor 135. The image data may be directly imported into the sculptor 115 
5 and then, later on, possibly be stored in the image data 137. 

The calibration frame 140 is an apparatus that includes a number of 
calibration targets that can be seen in the patient images 150. The calibration 
frame 140 is worn by the patient during the capturing of the patient images.. 
The patient model data 139 represents the data generated by the sculptor 115 
10 that can be used to morph the patient specific model 160 and any other 

information that would be important to patient records. This output of the 
sculptor 1 1 5 can be included the form of two transport files, the (.scl file and xln 
file). The executor passes these files to the clinician/consultant. 

Turning to the clinician/consultant 125, the data from the sculptor 1 15 is 
15 used by the clinician/consultant 125 to morph a stock anatomy model into a 

patient specific model 160. The stock anatomy model is 3D model of a standard 
person's anatomy (e.g., a skull possibly having flesh). The clinician/consultant 
125 morphs the stock model into the patient specific model, allows users 
visualize what a patient's anatomy looks like. Simulations of treatment plans can 
20 be shown in the cUnician/consultant 125. Also, because the patient specific data 
137 defines the relative location of a number of parts of the patient's anatomy, 
the cUnician/consultant 125 can be used to perform various types of analyses on 
the patient's anatomy. The results of these analyses can be then displayed on the 
patient images and as well as in the example analysis window 127. 

- 12 - 
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In the example, which is described throughout, the particular model used will 
be a stock model of a human skull. The human skull can be used by an 
orthodontist in planning for, and carrying out, a treatment plan for a particular 
patient. In this example, the model will have a number of objects including 
5 objects corresponding to each of the patient's teeth, the jaw, and other elements 
of the skull. Importantly, each of these objects can be manipulated individually 
in the clinician/consultant 125. 

An example of a stock model that may be used is. one from Viewpoint Data 
Labs which is specifically created for orthodontic applications. A full custom 
10 stock model can also be used. The stock model represents the average structure 
of a piece of anatomy. The Executor (database) will compile normative stock 
models to match patient demographics of age, race, sex and body type. The 
stock model has a coordinate system where each point is referenced to another 
point within itself. The information retrieved in the sculptor 115 allows that 
15 stock model to be morphed according to the dimensions and measurements from 
the sculptor 115. Examples of the individual objects available in the generic 
stock model, and the resulting patient specific model 160, include individual 
teeth, the jaw, and the skull. Each of these objects has a separate coordinate 
system which is referenced to the coordinate system in the patient specific 
20 model 160. In this way, when a particular object is selected, one may manipulate 
that object and change its relationship to the global reference system of the 
patient specific model 160. 

-13- 
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Other aspects of the invention are some of the new user interfaces features 
presented in the sculptor 1 15 and/or the clinician/consultant 125. These new 
user interface features will be described in greater detail below. 

Figure 2 illustrates the various responsibilities of each of the three programs 
5 of Figure 1. 

The sculptor 1 15 is responsible for input/output control of the patient 
images 150. The sculptor 115 allows for a calibration between the various 
images. 3D measurements of various locations defined in the calibration process 
can then be determined. The sculptor 115 includes a graphical user interface for 
10 performing the various features of the sculptor 115. The viewer supports the 
viewing of 3D models (useful where a piece of anatomy needs a more detailed 
identification). 

The model matching allows a user to match portions of the stock model to 
points on one or more patient images 150. In addition, model matching includes 

15 the ability to spatially match or register two models of the same patient at 

different points in time. Thus, areas of a model that are not already predefined in 
the sculptor 1 15 can be defined. These new locations can then be used for more 
accurate morphing process of the particular part of the anatomy of interest, will 
facilitate a morphological comparison of two patient specific models and will 

20 facilitate the comparison of patient specific models to normative data. For 

example, is one part of a patient's anatomy requires specialized treatment, a more 
detailed patient specific model 160 may be desired. In such a case, the sculptor. 
115 allows the user to identify the location of previously undefined points of the 
stock model in the patient images 150. 

- 14- 
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The executor 135 takes responsibility for the database storage and 
transferring of the image data 137 and the patient model data 139. The 
executor 135 includes Internet access for communicating with one or more 
sculptors 1 1 5 and one or more clinician/consultants 125. The executor 135 also 

5 has encryption capabilities to protect the security of the information stored by 
the executor 135. 

The chnician/consultant 125 includes the following functions. Diagnosis, 
treatment planning, predictions, analyses, and metrics, are all examples of the 
type of functions that can be performed on the patient specific model 160 and 
10 patient model data 139. Examples of these areas are described in greater detail 
below. The clinician/consultant 125 also keeps track of the stock objects, or 
stock models, that may be used in the morphing processes. 

The clinician/consultant 125 includes a graphical user interface and viewer 
for viewing patient information, the 3D model, analysis, etc. 
1 5 The morph editor is used to modify any morphing that is done to generate 

the patient specific model 1 60. 

The simulator simulates the motion of objects within the patient specific 
model 160. The simulator could also be used to simulate the predicted motion of 
objects in the patient specific model 160. Thus, the simulator can be used to 
20 simulate the movement of a jaw, or treatments such as the straightening of teeth. 
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Image Capture Example 

Figure 3 illustrates example relationships between a patient, a camera and 
other imaging technologies, for the purpose of capturing images. The capture 
images can then be imported into the sculptor 115. 
5 A patient 3 00, a camera 3 1 0 and an x-ray device 320 are shown in Figure 3 . 

The camera 310 and the x-ray device 320 can be used to capture the image data 
137. These captured images can be all from one camera, x-ray machine, or the 
like. However, some of the more important features of the invention can be 
realized when mixed modes of image capturing are combined. In this example, 
10 two devices, the camera 3 10 and the x-ray machine 320, are used to capture 
image data about the patient 300 from multiple vantage points. Other example 
modes of image capture include MRIs, ultrasound imaging, infrared imaging, and 
the like. The camera 3 1 0 and x-ray 320 are merely symbolic of the fact that 
images of the patient are captured using various types of imaging technology. 
15 In the orthodontic application, it is desirable to have both x-ray (both skeletal 

and soft tissue) and optical modes for capturing images of the patient 300. 
Although the camera 3 10 and x-ray device 320 are shown in the plain of 
Figure 3, this is not necessary, and in fact, may not be desirable. In the example 
of an orthodontic application, the preferred x-ray images would include a frontal 
20 image, a lateral image, and a frontal image with the head tipped back. The 
preferred photographic images may include a frontal image and two lateral 
images. 

-16- 
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Exam ple Calibration Frame 

Figure 4 illustrates a front view and a side view of a calibration frame 140 

that may be used in some embodiments of the invention. Images of this 

calibration frame 140 appears in the patient images 150. The images of the 
5 calibration frame 140 can then be used in the sculptor 1 15 to calibrate the 

various images. 

The calibration process includes recording the anatomy with the calibration 
frame in place using any number of imaging modalities. The 3D location of the 
calibration markers and an associated co-ordinate system is included as a priori 

10 knowledge within the sculptor. Through calibration of each imported image, the 
sculptor computes the location of the imaging sources as a point source with 
seven degrees of freedom (DOF). Seven DOF includes the x, y, z, yaw, pitch, 
roll and focal length of the imaging source. The calibration process maps the 
associated images into the 3D matrix associated with the calibration frame. Two 

15 or more calibrated images, through a process of triangulation, can be used to 
determine the 3D location of any associated points on the image sets. 

The calibration frame 140 can include a top strap 405, a strap 410, an 
adjustment knob 420, and a plexi-glass frame 430. The top strap 405, the strap 
410, and the adjustment knob 420, work together to keep the calibration frame 

20 in a substantially fixed position on the patient 300. Thus, when the images of the 
patient are capture, from the various modes, a common reference frame is 
established. 

The following describes the calibration frame 140 in greater detail. The strap 
410 is designed to encircle the patient's 300 head. The top strap 405 is designed 
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to prevent the strap 400 assembly from dropping too far down on the patient's 

head. 

In some embodiments, the top strap 405 and the strap 410 are part of 
headgear normally associated with a welding visor from which the face shield has 

5 been removed. 

One of the problems with the welding headgear, by itself, is that it flexes in 
ways that are undesirable for image capture. This prevents a good common 
reference frame from being established. Accordingly, a rigid plexi-glass frame 
430 is used to mount a number of calibration targets 440. The circumference of 
1 o the strap 4 1 0 is adjusted using a ratchet and a knob 420. They can be used to 
adjust the amount of overlap between the ends of the strap 410. 

The calibration targets 440 provide measurement references during the 
calibration of the various patient images 150. The calibration targets 440 include 
a number of spherical shapes, possibly having substantial x-ray attenuation 
15 properties. However this is not a requirement, and may not be desirable 

depending on the imaging technology that is being used to capture the patient 
images 150. Alternative embodiments can include different materials such as cod 
liver oil capsules as calibration targets 440. Alternative embodiments can also 
include different shapes of calibration targets 440, such as crosses. Although 
20 BBs, such as shot gun pellets, could be used, it is preferred to use bearings 

because their spherical shape is held to a closer tolerance. A characteristic of the 
calibration targets 440 is that they are visible in both optical and x-ray images. 
However, what is important with respect to the calibration targets 440 is that 
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they provide a fixed reference frame by which patient images 150 can be 
calibrated. Thus, they should be viewable in each of the patient images 150. 

Importantly some of the calibration targets 440 can be of different types of 
materials such that some of the calibration targets 440 appear in some of the 
5 images while others of the calibration targets appear in others of the images. As 
long as enough of the calibration targets 440 are visible in enough of the images, 
calibration can be performed. 

Additionally, a single calibration target could be made of different materials. 
For example, a cod liver calibration target could be positioned very close to a 
10 crosshair. The crosshair would indicate the position of the calibration target in 
the photographs, while the code liver oil capsule would indicate the position of 
the calibration target in MRI images. 

Generally the calibration targets 440 are positioned in the calibration 
frame 140 such that it is unlikely that in any one image the calibration targets will 
15 overlap to any great extent. It is also preferable, that at least four of the 

calibration targets are visible from each image perspective. Thus the shape of 
the calibration frame for holding the calibration targets 440 may vary from 
medical application to medical application. Thus multiple different calibration 
frames can be supported in the sculptor 115. Importantly, when the images have 
20 been captured, a session folder is created in which to store the images from the 
session, and the patient data are stored in a patient folder of the file management 
system operated under control of the executor 135. The type of calibration 
frame used 140 can also be stored with that information. 
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The attachment 450 (also referred to as an appliance) represents another way 
in which calibration targets can be included in images of the patient 300. For 
example, where a particular image is restricted to a small area of the patient's 
head, the calibration attachment 450 can be still used to calibrate. For example, 

5 where an x-ray image is collimated to only focus on a smaller portion of the 

patient's face, the calibration targets 440 in the attachment 450 would still appear 
in that x-ray image. 

Figure 5 illustrates another embodiment of the calibration frame 140. In this 
example, the plexi-glass frame 430 has a number of bends instead of the 
10 continuous curve shown in Figure 4. This facilities the attachment of calibration 
attachments 450 to the calibration frame 140. 

Figure 5 illustrates a top view 502, a front view 504 and a cross section view 
506 of the calibration frame 140. The front view 504 and the cross section view 
506 illustrate how attachment sites 530 can be included on the calibration 
15 frame 140. (Note, the top view 502 does not illustrate the attachment sites 530, 
but the sites may be viewable from the top view 502.) 

The cross sectional view 506 illustrates how an attachment can be attached 
to an attachment site 530 using a captive neural thumb screw 550. The 
attachment 450 can be stabilized using dowel pins 560. This example illustrates 
20 an acrylic appliance (attachment 450). 

Importantly, Figure 5 illustrates an acrylic appliance support that can be used 
a part of the calibration frame 140. This is merely illustrative of how appliances 
or attachments 450 could be attached to the calibration frame 140. What is 
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important is that there is some way to include calibration targets 440 in different 
images that may not include the the calibration frame 140. 

F.vam ple Method of Creating and Usin g Patient Specific Data 

Figure 6 illustrates one embodiment of the invention where the programs of 

5 Figure 1 are executed on one or more computers 110. In this example, the 
patient images 150 are calibrated to generate the patient specific model 160. 
This information is also used to perform a number of analyses on the patient 
model and related data. Figure 6 can be broken down into three general 
processes: a capturing of the patient specific data 602, generating the patient 

10 model 604, and performing analyses and related work on the patient model and 
related data 606. 

Starting with the capturing of the patient specific data 602, at block 610, the 
calibration frame 140 is mounted on the patient 300 head. This can be done by a 
technician at a medical facility. The top strap 405, the strap 410 and the 
15 adjustment knob 420 can be use to snuggly fit the calibration frame 140 to the 
patient's 300 head. 

Next, at block 620, a number of different images of the patient are captured. 
Importantly, the calibration frame 140 and/or the attachments 450 are included in 
these images. 

20 Next, at block 630, the sculptor 115 is used to import all the image data 137. 

This image data 137 is now calibrated using the image information of the 
calibration frame 140. In particular, each patient image 150 is associated with a 
calibration frame template (a computer representation of the calibration frame 
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140). A user will match a calibration frame template up with the image of the 
calibration frame 140 in each of the patient images 1 50. This tells the 
computer 1 10 how the calibration frame 140 is oriented and positioned in the 
image. Thus, all the points within the image can now be associated with, or 
5 referenced to, the calibration frame 140. 

As noted above, the calibration process involves calibrating locations relative 
to the position of the calibration frame 140. As part of this process, it is 
convenient to define a coordinate system for a particular patient. This 
coordinate system can then be mapped into the various views for patient 
10 images 1 50. For example, a first plane may be defined that is parallel to 

approximately the patients pupils. A y-plane can then be defined through the 
mid-sagittal plane of the patient. The last center plane can be determined from 
the cross product of the other two planes. 

Next, at block 640, a number of anatomic locations in each of the images are 
15 identified. Examples of this process are described below. What is important, 
however, is that a set of all the anatomic locations in the patient images 150 is 
defined. Appendix A includes a list of those locations. 

An example of identifying anatomic location 640 would include such things 
as identifying the locations of the ears, a trace of the jaw, the various points on 

20 specific teeth. 

The set of anatomic locations that need to be defined is dependent upon what 
stock model is to be used and how well the resulting morphed patient specific 
model 160 should match with the patient's exact anatomy. For example, if only a 
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portion of a skull is to be modeled, only those anatomical locations associated 
with that portion of the skull need be identified. 

Different medical applications may have different specific features of interest 
that are identified in the identification of anatomic locations. Orthodontists, for 
5 example, tend to concentrate on landmarks in the skull. These landmarks tend to 
be points concentrated on the mid-sagittal plane, teeth, and jaw. The ability to 
identify these landmarks and cross correlate them in the various patient 
images 1 50 is an important feature for specific medical applications. However, 
the specific features and anatomic locations that are important to a particular 
10 discipline will vary from application to application. Once the calibration frame 
has been used to calibrate the various patient images 150, however, all images 
and anatomic locations can then be referenced to that calibration frame. This 
information can then be stored in the transport file (.scl file). 

The following describes an example way of identifying a landmark in more 
15 than one image. It is important to identify the landmark location in multiple 
views to completely determine the 3D co-ordinates (x, y, z) of that landmark. 
To do this, the user can perform the following steps using the computer 1 10. 
First, the user selects a point to be identified. Next, the user then places that 
point in one of the images. The sculptor 1 15 then generates a line through that 
20 point in each of the other images. The line (epi-polar line) originates from the 
imaging source and is projected through a landmark point of image A and onto 
all other images mapped into the 3D matrix. The display length of the line 
projected onto the other images through the point of interest is arbitrary but the 
• length of the hue can be constrained by a priori knowledge of geographic region 
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of the point of interest associated with each image. The projection of that line is 
displayed in each of the other images as noted. The display in the other images 
will appear different because the projection of that line, in 3D space, will be 
viewed from different perspectives in each of the images. The user now can use 
5 the projected line to identify the corresponding landmark location in the other 
images. By looking along the projected line in each of the images, one can 
quickly identify where the landmark should be located in that image. Once the 
point has been defined in two of the images, the point may be automatically 
defined in all of the other images. 
10 Rather than identifying individual points however, it is sometimes desirable 

to outline, or trace, certain anatomic features. The tracing can be done by 
specifying one or more connected points in a number of the patient images 150. 
An example of this would be tracing the outline of an eye socket in an x-ray 
image. This would be important for certain medical applications relating to the 
15 eye. This traced information could then be stored with the landmark location 
information. 

By using the calibration frame 140 and the relationship between the various 
images, an accuracy of 0. 1 mm can be achieved with respect to the location of 
landmarks and the tracing of anatomic parts. 
20 Thus the capture of the patient specific data process 602 has been completed. 

Next, the patient specific model 160 is generated in the generate patient model 
604 process. 

Once all the anatomic locations are identified in the sculptor 1 1 5, the data for 
that patient can be exported to the executor 135. This information can then be 
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loaded into the cnmcian/consuTtant 125. The clinician/consultant 125 includes a 
stock model which is to be morphed against the information drawn from the 
sculptor 1 15 for a particular patient. In this example, the anatomic locations 
identified in the sculptor 1 1 5 from the patient images 1 50 are all associated with 
5 the calibration frame 140. Thus, exact measurements relative to each other of 
anatomic locations have been identified. Thus relative location information is 
then used to morph the stock model into the patient specific model 160. This 
can be done using standard techniques for morphing data. The resulting patient 
specific model 1 60 includes all the object information in the original stock model 
10 but has been customized with the measurements of a specific patient. 

Importantly, this allows significant types of manipulations to be performed that 
have not previously been performed in medical imaging systems. Examples of 
these processes are now described. 

The following describes an example analysis that is performed using the 
15 patient specific model 1 60 and the other patient data. In this example, a patient 
model is displayed. An example of this is shown in the picture of the 
clinician/consultant 125 on the left hand side of the display area in Figure 1 . In 
this example, the model is shown as a number of dots in space. 

Within the cHnician/consultant 1 25, the user can select an analysis type from 
20 the analysis window 1 27. The analysis can be derived from either the landmarks 
that have been previously identified in the sculptor 115, from the morphed three 
dimensional model data in the patient specific model 160, or from measurements 
taken by the user from within the clinician/consultant 125. An example of the 
analysis performed is shown in the example analysis 170. This conforms to 
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block 670 of Figure 6. The example analysis 170 illustrates example output from 
an analysis procedure. In the case of orthodontics, measurements may be taken 
to perform any number of standard orthodontic analyses such as a Ricketts 
analysis or a McGrann analysis. Other types of analysis, treatments, etc. are 
5 described in the following sections. 

As part of the analysis, a user can use the clinician/consultant 125 to rotate 
and manipulate the patient specific model 160. The patient's face can be mapped 
onto the generic model from the photographs in the patient images 1 50. 

Other types of analysis, or evaluations, performed in the clinician/consultant 
10 125 are now described. 

For a particular tooth, which is a separate object, one may wish to select that 
tooth and move it somewhat out of its socket. This could be used for example in 
showing a patient what their teeth would look like if they were straightened. 
Alternatively, the axis of the tooth for a particular patient may be rotated from its 
15 present location to an ideal location. Using the model, by selecting the tooth, 
one could not only translate the tooth, but rotate it to show it in a different 
orientation with respect to the other elements in the patient specific model 160. 
In some embodiments of the invention, the viewing and manipulation of 
individual objects of the patient specific model 160 is done using the VRX 
20 viewer, commercially available from Synthonics Technologies, Inc. 

The user is able to hide objects in the patient specific model 160. This, 
would correspond, in the case of a tooth, to extracting a tooth, leaving more 
room for reorienting other teeth in the jaw. 
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In the case of an orthodontics application, there are certain standard 
viewpoints used by orthodontists. These include an interior view, a superior 
view, a lateral view, a frontal view, intra-oral view, and/or an extra-oral view. 
Once adjustments have been made to the generic stock model, to reflect the 
5 patient specific features, i.e., the generation of the patient specific model 160, a 
treatment plan can be applied. The patient specific model 160 can be rendered 
by placing a skin over the model to show the external appearance after the 
modifications have occurred. An example of such a system that would allow this 
is QuickLook trademark rendering product from Synthonics Technologies, Inc. 
i o This permits photorealistic texturing of the model, so the patient can see their 
actual face after the orthodontic work has been completed. 

When using this invention for various medical applications, one can use the 
capabilities of the software and the models to display and communicate to 
patients what will be occurring with respect to their treatment. Patients can 
1 5 visualize the changes that will occur in their mouth as a result of some 
orthodontic treatment. 

Further, by using the techniques described herein to generate the three 
dimensional model, one achieves such a model with a much lower dosage of 
radiation than would be required, for example, if such a model were constructed 
20 by a CAT (Computer Assisted Tomography) scan. 

Further, by constructing a transport file that contains only limited patient 
specific information, a user need only identify, for example, two hundred 
landmarks in an orthodontic application, versus hundreds of thousands or so 
vertices that would be required for completely defining the patient specific 
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model 160 by itself. As a result, the full patient specific information can be 
transmitted through a relatively low bandwidth network in a relatively small 
amount of time. Such information could be transported over the Internet to 
insurance companies, patients, and specialists. This is significantly different than 

5 what is required to transfer full three dimensional models over a network. Thus, 
measurement data could be taken in the sculptor 1 1 5 and sent to a dental lab 
across the network very quickly and efficiently. Alternatively, information about 
the patient specific model 160 can be transmitted across the network with the 
same minimal bandwidth requirements to a dental lab, where a finished bridge 

10 could be produced in accordance with the specification and measurements 
contained in the patient specific file. 

Automated Calibration Tarp f* Identification 

The following describes an example system for automatically identifying the 
calibration targets 440. In this example, BBs will be used as calibration targets, 

15 however, the general process can be used for most any type of calibration target. 
The image of each BB is circular in the patient images 150. This is why the 
spherical shape was chosen, so it's image would be circular, regardless of the 
viewing angle. For a given camera geometry, one would expect the blob formed 
by the image of a BB in the film to have a certain size. Specifically, one would 

20 expect a BB to appear with a diameter of a certain number of pixels for a 

particular camera geometry. One can select the correlation patch corresponding 
substantially to that expected size and shape and then search over the patient 
image space looking for correlations between the portion of an image underlying 
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the correlation patch with the corresponding pixels for the expected blob pixel 
set. The points with the highest correlation are likely the locations of the BB. 
When this has been done for each BB in a particular set of patient images 1 50, 
one can identify the centroid of the region in three dimensional space formed by 
5 the intersection of the projections of a BB image from different patient images. 
The centroid location in 3D space is then determined as the center of the BB 
relative to the calibration frame 140. This information can then be stored and 
associated with that particular image. 

The above process describes a fully automated calibration target 
10 identification technique. However, in other embodiments of the invention, the 
user can drag and drop calibration target identifiers near a calibration target, and 
the computer 1 10 (the sculptor 1 15) can look for a calibration target near where 
the user dropped the calibration target identifier. 

Sculptor Interface Examples 

15 Figure 7 iUustrates the sculptor 1 1 5 application interface. This is shown as 

sculptor interface 715. Sculptor interface 715 includes a sculptor toolbar 720 for 
performing various functions in the sculptor 115. In this example figure, a 
patient image 750 is being displayed. Patient image includes a view of the 
patient 300 and view of the calibration frame 140. 

20 Figure 8 illustrates the placement of an unaligned calibration template 8 10 in 

the patient image area. The unaligned calibration template 810 will be aligned 
over the next few figures to show how the sculptor 1 15 can be used to determine 
a calibration reference frame for a patient image. 
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Figure 9 shows that a number of calibration target selectors 910 have been 
placed over the calibration targets 440 in the patient image 750. The calibration t 
target selector 910 is dragged and dropped onto a calibration target in the image 
of the calibration frame 140. 
5 Figure 1 0 illustrates the partially aligned calibration template 110. The 

partially aligned calibration template 1010 has been aligned using the calibration 
target selectors 910. 

Figure 1 1 illustrates the aligned calibration template 1110. The aligned 
calibration template 1110 now provides the sculptor 1115 with a reference frame 
10 for the patient image 750. 

Figure 12 illustrates the sculptor interface 715 having a second patient image 
1250 being displayed. The calibration frame 140 can be seen in both of the 
images. Additionally, the aligned calibration template 1 1 10 can be seen. A 
similar alignment process was performed to align the calibration template in the 
15 patient image 1250. 

Figure 13 illustrates the placement of a coordinate reference origin 1310 to 
define a reference plane for use by the user. The reference planes help in the 
identification of anatomic locations. 

Figure 14 illustrates creating a trace using the sculptor 1115. In this 
20 example, a trace name 1410 is displayed in the sculptor toolbar 720. In this 

example, the trace name 1410 is the mid-line soft tissue trace. A user has traced 
his midline soft tissue trace 1410 in at least two of the patient images 150. The 
midline soft tissue trace 1410 is also shown in the patient image 1450. This may 
be the preferred image to trace the mid-line soft tissue trace 1410. The reason 
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for this is that the profile of the patient's soft tissue is most easily seen in this 
image. The midline soft tissue trace 1410 can also be defined in the patient 
image 750. The sculptor 1 15 then propagates this trace to the patient image 
1250. 

5 Figure 15 illustrates a user interface enhancement in the sculptor 1 1 5 . In 

particular the sculptor 115 allows the user to perform a localized histogram 
normalization in a patient image. For example, localized enhancement 1510 is 
performed in the patient image 1250. This allows the user to enhance portions 
of the various images. 
10 Figure 16 illustrates a trace and landmark view 1620 where the patient image 

1250 is removed from the display. This further allows the user to determine 
where traces and landmarks are being positioned. In particular the example 
traced 1610 is shown. By removing the patient image 1250, the example trace 
1610 can be more easily seen. 
15 Figure 17 illustrates a rotated view 1720 of the example trace 1610. The 

user can rotate the traces, or otherwise manipulate the traces. In one 
embodiment of the invention, the viewer tool used in the clinician/consultant 125 
is also used for rotating and displaying the traces. 

Figure 18 illustrates a number of landmarks and traces being displayed in 
20 multiple images. In particular landmarks and traces can be seen in the patient 
image 1450, the patient image 750, the patient image 1850, and the patient 
image 1250. This allows for some basic measurement and analysis features of 
the sculptor 1 15 to be used. 
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Figure 19 illustrates a measure between a bone and a soft tissue point. In 
this example, the distance measured is the distance from the post nasal spine 
landmark to the midline soft tissue trace. The measurement line 1910 illustrates 
where the measurement is taking place. The measurement information 1920 

5 shows how many millimeters long the measurement line 1910 is. This 

calculation can be made because the patient image 1250 has been calibrated with 
the calibration template 140. 

Figure 20 illustrates how epi-polar lines 2020 can be used in the placement 
and location of landmarks and traces. In this particular example, a post nasal 

10 spine landmark is being shown using epi-polar lines 2020. The post nasal spine 
landmark 2010 was first placed in the patient image 1250. This caused epi-polar 
lines to be shown in the other two images. Next the post nasal spine landmark 
2010 was identified on one of the epi-polar lines in the patient image 1 850. This 
automatically placed the post nasal spine landmark marker 2010 into the last 

15 patient image 2050. 

Figure 21-24 illustrates the creation of a trace. In Figure 21 , a right 
mandible trace 21 10 is shown. This trace was performed by a sequence of click 
and drag actions. The right mandible trace 2110 includes a number of trace 
points, such as a trace point 2120. These trace points are connected in the line 

20 to form the trace. Now the user will make the same trace in a different patient 
image. 

In Figure 22, a portion of the right mandible trace 21 10 is being created in 
the patient image 1850. The trace line 2200 corresponds to the right mandible 
trace 2110. The trace line 2200 has, or will have, the same number of points as 
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the right mandible trace 2110. The sculptor 115 ensures this. When the user 
places a trace point down such as the trace point 2210, the trace line 2200 
extends from that point and shows where the next trace point 2220 would be 
placed along the trace line 2200. The user can then manipulate the location of 

5 this next trace point 2200 by dragging the trace line 2200 into the appropriate 
location. When the user has placed the next trace point 2200 in the appropriate 
location, the user can then select using a mouse click to position the next trace 
point 2200 permanently. Then another trace point is displayed until all of the 
trace points in the right mandible trace 2110 have been placed. This provides a 

10 particularly simple method of propagating a trace from one patient image to the 
next patient image. 

Figure 23 illustrates the placement of the trace point 2220 after the user has 
clicked on the mouse. Once the right mandible trace 21 10 has been completely 
laid down (2D trace) in the patient image 1850, the epi-polar lines of points on 
15 the right mandible trace can be projected onto any other calibrated patient image. 
These epi-polar lines constrain the identification of the corresponding landmark 
to those lines. Once the correspondence has been completed and the 3D co- 
ordinates of the points on the trace have been computed (triangulated) then the 
right mandible trace 21 10 can automatically be propagated to another calibrated 
20 patient image. Thus by defining the right mandible trace 21 10 in two images, the 
right mandible trace 21 10 has been completely defined in the space 
corresponding to the calibration frame 140. Therefore wherever the calibration 
frame 140 is identified, the corresponding location of the right mandible trace 
2110 can be determined by the sculptor 115. 
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Clinician/Consult ant Interface Examples 

Figure 25 through Figure 40 illustrate various user interface features of the 
clinician/consultant 125. These figures illustrates how a user can access the 
patient specific model data, create and manipulate the patient specific model 160, 
5 and perform analysis, treatment and the like on the model and the model data. 

Figure 25 illustrates an .SCL file load window 2510 that can be use to load a 
.SCL file. In this example, the .SCL file is the patient specific file 2520 that was 
generated in Figure 7 through 24. 

Figure 26 illustrates the morphing interface 2600 that can be part of the 
10 clinician/consultant 125. Here the patient image 750 is shown with a partially 
morphed stock model 2610. After the morphing is complete, the patient specific 
model 1 60 is created. The morphing interface 2600 need not be used by the 
medical practitioner, but it does help illustrate the morphing process. 

Figure 27 illustrates a morphed and texture mapped patient specific model 
15 view 2710. Here the patient specific model view has been rotated. Note that the 
photo image texture mapped onto the model is the patient image 750. 

Figure 28 illustrates a wireframe view 2810 of the patient specific model 160. 
The morphing interface 2600 allows the user to rotate the view of the patient 
specific model 160 and to change the way in which the model is displayed. 
20 Figure 29 illustrates a dot contour view 291 0 of the patient specific model 

160. The dot contour view 2910 shows the points that are used to define the 
patient specific model 160. During the morphing process, the points in the stock 
model are repositioned, according to the patient model data, to create the patient 
specific model 160. 
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Figure 30 illustrates the clinician interface 3010. The clinician interface 3010 
is the interface that would normally be used by the medical practitioner when 
performing analysis, developing a treatment, or presenting information to the 
patient. In this example, the clinician interface 3010 includes a patient specific 
5 model flesh view 3010. 

Figure 3 1 illustrates the patient specific model skull view 160 having a 
number of landmarks and control points showing. 

Figure 32 illustrates an example analysis that has been performed. Here a 
Steiner analysis has been performed on some of the anatomical locations 
10 identified in the sculptor 115. The analysis window 127 shows the results of the 
analysis. The patient image 1250 and the dot view of the patient specific model 
3210 show the analysis lines 3230. Normally, the medical practitioner would 
have had to draw these lines on the x-ray image, and then measure those lines. 
With the clinician/consultant 125, these processes are automated. 
15 Figure 33 illustrates a partially planned treatment where an arch form 

template 3320 has been put into the jaw object dot display 33 10. Importantly, 
the jaw object can be selected and manipulated separately from the rest of the 
patient specific model 160. Additionally, the medical practitioner can place an 
arch form template 3320 and perform simulations of how the teeth may will be 
20 affected by a particular treatment. Note that the user interface now includes a 
tool for defining the wire, pivot points, and alignment. 

Figure 34 illustrates a jaw object solid display 3410 where a particular tooth 
has been selected (shown as tooth selected display 3420). Figure 35 illustrates a 
similar view, except the jaw object dot display 3 5 1 0 is shown instead. 
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Figure 36 illustrates the where the user has partially extracted and tilted the 

tooth. This could be used to show a patient what an extraction would look like. 

Figure 37 illustrate the top view of this configuration. 

Figure 38 illustrates the jaw object solid display 3410 where the tooth has 

5 been extracted. 

Figure 39 illustrates another feature of the clinician/consultant 125 user 
interface where slice planes have been placed through the jaw object. The jaw 
object display 3920 is used for positioning the slice planes (e.g., slice plane 
3910). The jaw object display 3930 shows the results of the slice plane 3910. 

10 The clinician/consultant 125 user interface allows the user to position and 
control multiple slice planes through the object. 

Figure 40 illustrates a partially transparent slice plane 4010 and a partially 
transparent slice plane 4020 positioned though the jaw object display 3920. The 
jaw object display with transparent slices 4030 shows the result of the slice 

15 planes. 
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Appendix A 

The following table shows the landmarks and traces used in the creation of 
the patient specific model 160. Other embodiments of the invention can use 
other landmarks and/or traces. The following list has been chosen as they 
represent commonly referred to anatomic landmarks. 



// ===== landmarks == 

abbr Description 

LB_ME Menton 

LB_GN Gnathion 

LB PG pogonion 

LB~B B Point 

LB ID Infradentale 

LB~LIE Lower Incisor Incisal Edge 

LB~ADP Anterior Downs Point 

LB~UIE Upper Incisor Incisal Edge 

LB~UIL Labial of the Upper Incisor 

LB_SD supradentale 

LB~A A Point 

LB ANS Anterior Nasal Spine 

LB - UIA Upper Incisor Apex 

LB~UIB Upper incisor Lingual Bony Contact Point 

LB~LIB Lower incisor Lingual Bony Contact Point 

LB~LIA Lower incisor Apex 

LB~SYM Lingual Symphyseal Point 

LB~PMC Premolar Mesial Contact point 

LB~PDC Premolar Distal Contact point 

LB~LMR Lower Molar Root Apex 

LB~LMJ Lower Molar Mesial CEJ 

LB~LMC Lower Mesial Contact 

LB~UMT Upper Mesial Cusp Tip 

LB~ PDP posterior Downs point 

LB~LMIT Lower molar Mesial Cusp Tip 

LB_UMJ Upper molar Mesial CEJ 

LB~UMR Upper molar Root Apex 

LB~~UDT Upper molar Distal Cusp Tip 

LB~FPP Functional Occlusal Plane Point 

LB'LAB L Ant Border Ramus 

LBJRAB R Ant Border Ramus 

LB_LGO L Gonion 

LB RGO R Gonion 

LB~GOI Gonial Intersetction 

LB~LPB L Post Border Ramus 

LB~RPB R Post Border Ramus 

LB~PSE posterior Skull External 

LB~PSI Posterior skull internal 

LB^OCP Occipital Protuberance 

LB_I Inion 

LB_OP opisthion 

LB_BP Bolton point 

LB_BA Basion 

LB_AR Articulare Posterior 

LB_AA Articulare Anterior 

LB~CO Condylion 

LB_LCO L Condylion 

LB_RCO R Condylion 

LB_PO Porion 

LB LAPO L Anatomic Porion . 
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LB_RAPO 

LB_S 

LB_SE 

LB_GBI 

LB_GB 

LB_FSS 

LB_LSUP 

LB_RSUP 

LB_FSI 

LB_FMN 

LB_N 

LB_NB 

LB_LLO 

LB_RLO 

LB_LOR 

LB_ROR 

LB_IZ 

LB_PNS 

LB_PTMI 

LB_PTMS 

LB_LCP 

LB_RCP 

LB_3VS 

LB_3VA 

LB_3VI 

LB__3VP 

LB_3VC 

LB_3VSP 

LB_4VS 

LB_4VA 

LB_4VI 

LB_4VP 

LB_4VC 

LB_4VSP 

LB_COL 

LB__LA 

LB_RA 

LB_LM 

LB_RM 

LB_LAGO 

LB_RAGO 

LB_LR1 

LB_RR1 

LB_LR2 

LB_RR2 

LB_LR3 

LB_RR3 

LS_GL * 

LS_Na * 

LS_No 1 

LS_Sn ' 

LS_A' 

LS_UL ' 

LS_LV 

LS_B 1 

LS_Pog' 

LSJGn ■ 

LS_Me ' 

LS_URh' 

LS_LRh ' 

LS^UEm 1 

LS_LEm' 

LS_LEyM ' 

LS_LEyL 1 

LS_REyM ' 

LS_REyL 1 

LS_LLc ' 

LS_RLc ' 

LS LNp ' 



R Anatomic Porion 

Sella Turcica 

Ethmoid Registration Point 

Glabella internal 

Glabella 

Frontal Sinus Superior 
L Supraorbitale 
*R Supraorbitale 
Frontal Sinus Inferior 
Frontomaxillary nasal suture 
Nasion 
Nasal Bone 
L Lateral Orbit 
R Lateral Orbit 
L Orbitale 
PC Orbitale 
Inferior Zygoma 
Post Nasal Spine 

Pterygomaxillary Fissure Inferior 
Pterygomaxillary Fissure Superior 
L Coronoid 
R Coronoid 

3rd Vertebra Superior 

3rd Vertebra Anterior 

3rd Vertebra Inferior 

3rd Vertebra Posterior 

3rd Vertebra Canal 

3rd Vertebra Spine 

4th Vertebra Superior 

4th Vertebra Anterior 

4 th Vertebra Inferior 

4th Vertebra Posterior 

4th Vertebra Canal 

4th Vertebra Spine 

Columella 

L Articulare 

R Articulare 

L Mastoid 

R Mastoid 

L Antegonion 

R Antegonion 

L Rl 

R Rl 

L R2 

R R2 

L R3 

R R3 

Soft Tissue Glabella 
Soft Tissue Nasion 
Nose Tip 
Subnasale 

Soft Tissue A Point 
Upper Lip 
Lower. Lip 

Soft Tissue B Point 
Soft Tissue Pogonion 
Soft Tissue Gnathion 
Soft Tissue Menton 
Upper Rhinion 
Lower Rhinion 
Upper Embrasure 
Lower Embrasure 
L Eye Medial 
L Eye Lateral 
R Eye Medial 
R Eye Lateral 
L Corner Lip 
R Corner Lip 

L Posterior Nares 
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L5_RNp ' 
LS_LN1C ' 
LS_RN1C 1 
LS_LTr ' 
LS_RTr 1 
LS TH* 



// 



r posterior Nares 
L Nasolabial Crease 
R Nasolabial Crease 
L Tragus 
r Tragus 
Top of Head 



»OT E! *th. major's roier to thj tooth qu.drant CT.ott. »> 
i h ; 1 ^; 3 t^'i.^^«.rSin„ o„ t„. t..t h ato 

SS°m! °iS: - cS "JTi-Sd to ™»ip»i. M =P.=if« <«•«•• 

d = distal 

m = mesial 

1 = lingual 

b « buccal 

r = root tip 

i = incisal edge 

c = cervical 



abbr 

// ======== 

LT_llm21m 

11 and 21 

LTJLlr 

LT_llmi 

LT_lldi 

LT_llc 

LT_lldl2m 

11 and 12 
LT_12r 
LT_12di • 
LT_12mi 
LT_12c 
LT_12dl3m 

12 and 13 
LT_JL3r 
LT_13i 
LT_13c 
LT_13dl4m 

13 and 14 
LT_14r 
LT_141 
LT_14b 
LT_14c 
LT_14dl5m 

14 and 15 
LT_15r 
LT_151 
LT_15b 
LT_l5c 
LT_15dl6m 

15 and 16 
LT_16r 
LT__1 6ml 
LT_16dl 
LT_1 6mb 
LT_16db 
LT_16c 
LT_16dl7m 

16 and 17 
LT_17r 
LT_17ml 
LT_17dl 
LT_17mb 
LT 17 c 



landmark 
llm21m 



llr 
llmi 
lldi 
11c 

lldl2m 

12r 
12di 
12mi 
12c 

12dl3m 

13r 
13i 
13c 

13dl4m 

14r 
141 
14b 
14c 

14dl5m 

15r 
151 
15b 
15c 

15dl6m 

16r 

16ml 

16dl 

16mb 

16db 

16c 

16dl7m 

17r 
17ml 
17dl 
17mb 
17 c 



Description 

interproximal contact point between teeth #s 

Tooth #11 root tip 
Tooth #11 mesial incisal edge 
Tooth #11 distal incisal edge 
Tooth #11 cervical 

interproximal contact point between teeth #s 

Tooth #12 root tip 
Tooth #12 distal incisal edge 
Tooth #12 mesial incisal edge 
Tooth #12 cervical 

interproximal contact point between teeth #s 

Tooth #13 root tip 
Tooth #13 incisal tip 
Tooth #13 cervical 

interproximal contact point between teeth #s 

Tooth #14 root tip 
Tooth #14 lingual cusp tip 
Tooth #14 buccal cusp tip 
Tooth #14 cervical 

interproximal contact point between teeth #s 

Tooth #15 root tip 
Tooth # 15 lingual cusp tip 
Tooth # 15 buccal cusp tip 
Tooth # 15 cervical 

interproximal contact point between teeth #s 
Tooth #16 root tip 

Tooth #16 mesial lingual cusp tip 

Tooth #16 distal lingual cusp tip 

Tooth #16 mesial buccal cusp tip 

Tooth #16 distal buccal cusp tip 

Tooth #16 cervical , ^ _ „ 

interproximal contact point between teeth #s 

Tooth #17. root tip 

Tooth #17 mesial lingual cusp tip ■ 

Tooth #17 distal lingual cusp tip 

Tooth #17 mesial buccal cusp tip 

Tooth #17 cervical . 
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Tooth #17 distal buccal cusp rip 
Interproximal contact point between teeth #s 

Tooth #18 root tip 

Tooth #18 distal lingual cusp tip 

Tooth #18 mesial lingual cusp tip 

Tooth #18 mesial buccal cusp tip 

Tooth #18 distal buccal cusp tip 

Tooth #18* cervical 

Tooth #21 root tip 

Tooth #21 distal incisal edge 

Tooth #21 mesial incisal edge 

Tooth #21 cervical 

Interproximal contact point between teeth #s 

Tooth #22 root tip 
Tooth #22 distal incisal edge 
Tooth #22 mesial incisal edge 
Tooth #22 cervical 

Interproximal contact point between teeth #s 

Tooth #23 root tip 
Tooth #23 incisal tip 
Tooth #23 cervical 

Interproximal contact point between teeth #s 

Tooth #24 root tip 
Tooth #24 lingual cusp tip 
Tooth #24 buccal cusp tip 
Tooth #24 cervical 

Interproximal contact point between teeth #s 

Tooth #25 root tip 
Tooth #25 lingual cusp tip 
Tooth #25 buccal cusp tip 
Tooth #25 cervical 

Interproximal contact point between teeth #s 
Tooth #2 6 root tip 

Tooth #26 mesial lingual cusp tip 
Tooth #2 6 distal lingual cusp tip 
Tooth #2 6 distal buccal cusp tip 
Tooth #2 6 mesial buccal cusp tip 
Tooth #2 6 cervical 

Interproximal contact point between teeth #s 

Tooth #27 root tip 

Tooth #27 distal buccal cusp tip 

Tooth #27 mesial buccal cusp tip 

Tooth #27 mesial lingual cusp tip 

. Tooth #27 distal lingual cusp tip 

Tooth #27 cervical 

Interproximal contact point .between teeth #s 

Tooth #28 root tip 

Tooth #28 mesial lingual cusp tip 

Tooth #2 8 distal lingual cusp tip 

Tooth #28 distal buccal cusp tip 

Tooth #28 mesial buccal cusp tip 

Tooth #28 cervical 

Interproximal contact point between teeth #s 

Tooth #31 root tip 
Tooth #31 distal incisal edge 
Tooth #31 mesial incisal edge 
Tooth #31 cervical 

Interproximal contact point between teeth #s 
Tooth #32 root tip 



LT_17db 

LT_17dl8m 

17 and 18 

LT_18r 

LT_18dl 

LT_18ml 

LT_18mb 

LT_18db 

LT_18c 

LT_21r 

LT_21di 

LT_2 lmi 

LT_21c 

LT_21d22m 

21 and 22 
LT_22r 
LT_22di 
LT_22mi 
LT_22c 
LT_22d23m 

22 and 23 
LT_23r 
LT_23i 
LT_23c 
LT_23d2 4m 

23 and 2 4 
LT_2 4r 
LT_2 41 
LT_24b 
LT_24c 
LT_24d25m 

24 and 25 
LT_25 
LT_251 
LT_25b 
LT_25c 
LT_25d2 6m 

25 and 26 
LT_2 6r 
LT_2 6ml 
LT_2 6dl 
LT_2 6db 
LT_2 6mb 
LT_2 6c 
LT_2 6d27m 

26 and 27 
LT_27r 
LT_27db 
LT_27mb 
LT_27ml 
LT_27dl 
LT__27c 
LT_27d28m 

27 and 28 
LT_28r 
LT_2 8ml 
LT_28dl 
LT_28db 
LT_28mb 
LT_28c 
LT__3 lm41m 
31 and 41 
LT_31r 
LT_31di 
LT_31mi 
LT_31c 
LT_31d32m 
31 and 32 
LT 32r 



17db 
17dl8m 

18r 

18dl 

18ml 

18mb 

18db 

18c 

21r 

21di 

2 lmi 

21c 

21d22m 

22r 
22di 
22mi 
22c 

22d23m 

23r 
23i 
23c 

23d24m 

24r 
241 
24b 
24c 

24d25m 

25r 
251 
25b 
25c 

25d2 6m 

26r 
2 6ml 
2 6dl 
2 6db 
2 6mb 
26c 

2 6d27m 

27r 
27db 
27mb 
27ml 
27dl 
27c 
. 27d28m 

28r 

28ml 

28dl 

28db 

28mb 

28c 

31m4 lm 

31r 
31di 

3 lmi 
31c 

31d32m 
32r 
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LT_32di 
LT_32mi 
LT_32c 
LT_32d33m 

32 and 33 
LT_33r 
LT_33i 
LT_33c 
LT_33d34m 

33 and 34 
LT_34r 
LT_34b 
LT_341 
LT_34c 
LT_34d35m 

34 and 35 
LT_35r 
LT_351 
LT_35b 
LT_35c 
LT_35d36m 

35 and 3 6 
LT_36r 
LT_36ml 
LT_3 6mb 
LT_36db 
LT_3 6c 
LT_36dl 
LT_3 6d37m 

36 and 37 
LT_37r 
LT_37dl 
LT_37db 
LT_37mb 
LT_37ml 
LT_37c 
LT_37d38m 

37 and 38 
LT_38r 
LT__38db 
LT_38mb 
LT_38dl 
LT_38ml 
LT_38c 
LT_41r 
LT__41di 
LT_4 Imi 
LT_41c 
LT_41d42m 

41 and 42 
LT_42r 
LT_42di 
LT_42mi 
LT_42c 
LT_42d43m 

42 and 43 
LT_43r 
LT_43d 
LT_43c 
LT_4 4m 
contact 
LT_4 4d 
contact 
LT_4 4r 
LT_44b 
LT_4 41 
LT_4 4c 
LT__45m 
contact 



32di 
32mi 
32c 

32d33m 

33r 
33i 
33c 

33d34m 

34r 
34b 
341 
34c 

34d35m 

35r 
351 
35b 
35c 

35d3 6m 

36r 
36ml 
3 6mb 
3 6db 
3 6c 
36dl 
36d37m 

37r 

37dl 

37db 

37mb 

37ml 

37c 

37d38m 

38r 

38db 

38mb 

38dl 

38ml 

38c 

41r 

41di 

4 lmi 

41c 

41d42m 

42r 
42di 
42mi 
42c 

42d43m 

43r 
43d 
43c 
4 4m 

44d 

44r 
4 4b 
441 
44c 
45m 



Tooth #32 distal incisal edge 
Tooth #32 mesial incisal edge 
Tooth #32 cervical 

Interproximal contact point between teeth #s 

Tooth #33 root tip 
Tooth #33 incisal tip 
Tooth #33 cervical 

Interproximal contact point between teeth #s 

Tooth #34 root tip 

Tooth #34 buccal cusp tip 

Tooth #34 lingual cusp tip 

Tooth #34 cervical ' 

Interproximal contact point between teeth fs 

Tooth #35 root tip 
Tooth #35 lingual cusp tip 
Tooth #35 buccal cusp tip 
Tooth #35 cervical 

Interproximal contact point between teeth #s 
Tooth #3 6 root tip 

Tooth #36 mesial lingual cusp tip 
Tooth #3 6 mesial buccal cusp tip 
Tooth #3 6 distal buccal cusp tip 
Tooth #3 6 cervical 

Tooth #36 distal lingual cusp tip 
interproximal contact point between teeth #s 

Tooth #37 root tip 

Tooth #37 distal lingual cusp tip 

Tooth #37 distal buccal cusp tip 

Tooth #37 mesial buccal cusp tip 

Tooth #37 mesial lingual cusp tip 

Tooth #37 cervical 

Interproximal, contact point between teeth *s 

Tooth #38 root tip 

Tooth #38 distal buccal cusp tip 

Tooth #38 mesial buccal cusp tip 

Tooth #38 distal lingual cusp tip 

Tooth #38 mesial lingual cusp tip 

Tooth #38 cervical 

Tooth #41 root tip 

Tooth #41 distal incisal edge 

Tooth #41 mesial incisal edge 

Tooth #41 cervical 

Interproximal contact point between teeth #s 

Tooth #42 root tip 
Tooth #42 distal incisal edge 
Tooth #42 mesial incisal edge 
Tooth #42 cervical 

Interproximal contact point between teeth ffs 
Tooth #4 3 root tip 

Tooth #43 distal interproximal contact 
Tooth #43 cervical 

Tooth #4 4 mesial surface interproximal 
Tooth #4 4 distal surface interproximal 

Tooth #44 root tip 

Tooth #4 4 buccal cusp tip 

Tooth #4 4 lingual cusp tip 

Tooth #4 4 cervical 

Tooth #45 mesial surface interproximal 
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LT_45d 
contact 
LT_45r 
LT_4 5c 
LT_4 5b 
LT_4 51 
LT_4 6m 
contact 
LT_4 6r 
LT_4 6mb 
LT_4 6db 
LT_4 6dl 
LT_4 6c 
LT_4 6ml 
LT_4 6d47m 

46 and 47 
LT_4 7r 
LT_47mb 
LT_47db 
LT_47ml 
LT_47dl 
LT_47c 
LT_47d48m 

47 and 48 
LT_4 8 r 
LT_4 8mb 
LT_4 8db 
LT_4 8ml 
LT_4 8dl 
LT_4 8c 

tracedata 



{ o, 


SOFT, 


{ 1/ 


SOFT, 


{ 2, 


SOFT, 


{ 3, 


SOFT, 


{ 4, 


SOFT, 


{ 5, 


SOFT, 


( 6, 


SOFT, 


{ 7, 


SOFT, 


{ 8, 


SOFT, 


{ 9, 


SOFT, 


( 10, 


SOFT, 


{ 11/ 


SOFT, 


{ 12, 


SOFT, 


{ 13, 


SOFT, 


{ 14, 


BONE, 


{ 15, 


BONE, 


{ 16, 


BONE, 


{ 17, 


BONE, 


{ 18, 


BONE, 


{ 19, 


BONE, 


{ 20, 


BONE, 


{ 21, 


BONE, 


{ 22, 


BONE, 



4Sd 

45r 
45c 
45b 
451 
4 6m 

46r 
4 6mb 
4 6db 
4 6dl 
4 6c 
4 6ml 
4 6d47m 

47r 

47mb 

47db 

47ml 

47dl' 

47c 

4 7d4 8m 

48r 
48mb 
4 8db 
4 8ml 
4 8dl 
48c 



"TS 

"TS~ 

"TS~ 

"TS~ 

"TS" 

"TS~ 

"TS* 

"TS" 

"TS~ 

"TS~ 

"TS~ 

"TS~ 

"TS~ 

"TS* 

"tb" 

"TB* 
"TB* 
"TB' 
"TB 
"TB" 
"TB 
"TB* 
" TB 



Tooth #45 distal surface interproximal 

Tooth #45 root tip 

Tooth #45 cervical 

Tooth #45 buccal cusp tip 

Tooth #45 lingual cusp tip 

Tooth #4 6 mesial surface interproximal 

Tooth #4 6 root tip 
Tooth #46 mesial buccal cusp tip 
Tooth #4 6 distal buccal cusp tip 
Tooth #4 6 distal lingual cusp tip 
Tooth #4 6 cervical 

Tooth #4 6 mesial lingual cusp tip 
Interproximal contact point between teeth #s 

Tooth #47 root tip 
Tooth #47 mesial buccal cusp tip 
Tooth #47 distal buccal cusp tip 
Tooth #47 mesial lingual cusp tip 
Tooth . #47 distal lingual cusp tip 
Tooth #47 cervical 

Interproximal contact point between teeth #s 

Tooth #48 root tip 

Tooth #48 mesial buccal cusp tip 

Tooth #48 distal buccal cusp tip 

Tooth #48 mesial lingual cusp tip 

Tooth #48 distal lingual cusp tip 

Tooth #48 cervical 



MIDLINE", "Midline Soft Tissue Trace"}, 

"REBROW", "R Eyebrow trace"}, 

"LEBROW", "L Eyebrow Trace"}, 

"REAR", "R Ear trace"} 

"LEAR", "L Ear Trace"} 

"REYE" , "R Eye Trace"} 

"LEYE", "L Eye Trace") 

~RLIP", "R Lip Trace"} 

"LLIP", "L Lip Trace"} 

~RN", "R Nares Trace"), 

~LN", "L Nares Trace"), 

~RTH", "R Top of Head Trace"), 

~LTH", "L Top of Head Trace"), 

~FH" , "Front of Head Trace"), 

RLO", "R Orbit Trace"}, 

"LLO", "L Orbit Trace"}, 

~RMAND", "R Mandible trace"}, 

~LMAND", "L Mandible trace"), 

_RATop", "R Arch Top Trace"), 

RABot" , "R Arch Bottom Trace"}, 

LATop", "L Arch Top Trace"), 

LABot", "L Arch Bottom Trace"}, 

"MIDLINE", "Midline Bone Trace"}, 



There is a single trace for occlusal table for each of the 32 teeth. 
In addition, there is one trace for both dental arches that extends 
along the central groove and incisal edges of teeth. 

{ -1, MAX, " f \0"', "'NO'"}, , 
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Appendix B 

The following presents cephalometric analysis that can be performed using 



the clinician/consultant 125. 



Sterner Analysis 




Landmarks 


Mean Angle , 
{degrees) 


Mean Measurement 
(mmi 


SNA 


82 




SNB 


80 




ANB 


2 




SND 


76 




Ul-NA 


22 


4 


Ll-NB 


25 


4 


Po-NB 






Po to Li-NB 






Ul-Ll 


131 




Occl-SN 


14 




GoGn-Sn 


32 





Landmarks 


Mean Angle 
(degrees) 


Mean Measurement 
{nam) 


FMA 


22 




IMPA 


86 




FMIA 


62 




SNA 


82 




SNB 


80 




ANB 


2 




Wits Appraisal ACBO 




1 


Occlusal Plane to Frankfurt 




8 


Plane 






Z Angle 


76 




GoniontoPC 




64 


1 Menton -ANS 




67 




' 1 . McGnmit Analysis 




Landmarks 


Mean Angle 


Mean Measurement _ 




(degrees) 1 


{mm) 


Palatal to Mandibular Plane 


23 




Mandibular Plane to 


25 




Frankfurt 






Y Axis 


67 




SNA 


82 




Mandible to Cranium 




3 


SNB 


80 




ANB 


2 




Wits Appraisal ACBO 




1 
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. ; :-:"T >'n%fi nt *2 r*Lf 


VlfcGrann Analysis 
Mean Angle ' 


- 

Mean Measurement 
iram) - 


• 

Interincisal Angle 


IdeaneesV 
130 




IMPA 


86 




Lower 1 to Nasion-B 




4 


Bl to A-Po Plane 


75 




Al to McNamera Line 




4 


Nasolabial Angle 


115 




Lower Lip to Esthetic Plane 




-2 


Condylion-Gnathion 




115 


Condylion-A Point 




91 


Menton-ANS 




67 



landmarks ' ; 


fVliMin Ample 
1 decrees* 


(mm) 


oaQuie Angie iN-o-rv 


123 (+3) 




Articular Angle o-i-vju 


143 (+6) 




Gonial Angle I-Go-Me 


130 (+7) 




Sum Total J 


396 




Bisecting Gonial Angle Upper 
N-Go . . 


52-55 


3 


Bisecting Gonial Angle Lower 
N-Go 


70-75 




Anterior Cranial Base Length 




71 (+/- 3) 


Posterior Cranial Base Length 




32 (+/- 3) 


Ramus Heipht A-Go 




44 (+/- 5) 


Bodv Length Go-Me 




71 (+/- 5) 


Mandibular Body to Anterior 
Cranial Base Ratio 




1:1 


SNA (Jarabak) 


78 




SNB 


76-75 




ANB 


2 




SN-GoGn Anple 


32 




Facial Depth N-Go 






Facial Length on Y Axis 






Y Axis to Sn Angle 


64-68 




Posterior Facial Height S-Go 






Anterior Facial Height N-Me 






Ratio Posterior Facial Height 
to Anterior Facial Height (%) 






Facial Plane Angle Sn-Me 


82 





Jarahak Dental Analysis 




Landmarks 


Mean Angle Ws>. 


Mean Measurement 




■ (decrees) 


■ (mm) ' 


Occlusal Plane to GoMe 






Anple 






Interincisal Angle 1-1 


133 




LI to GoGn Angle 


90 (+/-3) 
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j*rS6 

Landmarks 


\ik Dental Analysis 
Mean Angle 


Mem Measurement .' 
•{rhni} 


Ul-Sn Angle 


1UZ K~f ) J 




Ul-Facial Plane fNPo) 




5 (+/-2) 


LI to Facial Plane (NPo) 




2 (+1-2') 


Facial Esthetic Upper Lip 




-1 


Facial Esthetic Lower Lip 







c 

Landmarks 


:iark Analysis . 
Mean Angle 
^degrees) 


•Mean Measurement 

- (mm ) , ^ 


Mandibular Arc 


27.4 




Cranial Base Angle 


27.8 




Facial Axis Angle 
Mandibular Plane to Frankfurt 


27.6 
25.2 




Cranio-Mandibular Anple 


25.2 




Condylar Axis Angle 

Upper Incisor Angle 


29.9 
23.1 




Lower Incisor Angle 


28:8 




Maxillary Plane Angle 


-0.4 




Nasal Angle 


7.1 




Occlusal Plane to Frankfart 
Convexity 


21.1 
1.9 




Bl to A-Po Plane 

A6 Molar Position to PTV 


1.0 
14.5 




Lower Lip to Esthetic Plane 


-1.6 





Landmarks 


owns Analyst 
Mean Angle 


Mean Measurement 
(mm) : 


Facial Angle 


88.1 




Mandibular Plane 


24.4 




Y-Axis 


59.4 




Angle of Convexity 


0.1 




ANB 


2 




Interincisal Angle 


130 




MD 1 to APo 


22 


1 


Md 1 to Mand. Plane 


90 




Mx 1 to APo 




3.5 


Nasi on- AN S 




50 


Nasion-Menton 




111.2 


Facial Height Ratio 




45 _ 



TKcUeti* Lateral Analysis 


Landmarks • • : 


Mean Angle 


Mean Measurement 
1 fmm> 


___ ' : " "' - : - 

Interincisal Angle 


(decrees) 
130 




Chin in Space 






Facial Axis -*1 


90 +/-3 
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l&cketfs&atL-rai Anai>*sis 




Landmarks 


Mean Angle. 


Mean Measurement 


Facial Anple Depth-* 2 


87 +/-3 




Mandibular Planed 3 


26 +/-4 




Facial Taper^4 


68 +/-3 




Lower Facial Height^ 5 


47 +/-4 




Mandibular Arc - * 6 


26 +/-4 




Convexity 






Convexitv A noint ^7 




2 +/-2 


Total Facial Height 


60 




Teeth 






Lower incisor to Apo -*8 






Upper molar to PtV^lO 




age +3 +/-4 


Mandibular incisor 
inclination-^ 9 


22+/-4 




Lower lip to E Plane-* 11 




-2 +/-2 









Mean Angle 
(decrees) 


-(mm) 


Intermolar Width (B6-B6) 




54 


Denture Midline 




0 


Max-Mand Width Left 




-10.2 


Max-Mand Width Right 




-10.2 


Denture to Jaw Midline 




0 


Nasal Width 




26.7 


Maxillary Width (J-J) 




61.8 


Mandibular Width (AG-GA) 




76 



1* BA-CC-Po 
2-> FH-N-Po 
3 -*MP-FH 

4- > _ . _ , 

5- > ANS-Xi to Xi to PM (PM = Point on anterior border of symphysis between Point B and 
Pogonion wher the curvature changes from concave to convex Xi constructed point 

6- *Xi-PM plane to X -DC (DC=a point selected in the center of the neck of the condyle wher 
the basion-Nasion plane crosses it. Basion (BA) most inferior posterior p;oint oof the occipital 
bone 

7«* A-Po plane to N-Po plane 
8 -* Tip lower incisor to APo 

9- * Apo-Lower incisal angle ( Incisal angle formed along the vertical long axis of tooth) 

10- * 

11- * E Plane -Soft tissue tip of Nose to Soft Tissue Pogonion-Lip is lower hp 









Landmarks 


Mean Angle 
' i degrees) . 


. Mean Measurement ■ ■ - 


Palatal Plane Length 




Not Established 


Pogonion to ANS Arc 




Not Established 
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Mean Angle 


IS;. 


|| ^ ; 

*D T>nint tn A Arc 
D fJUll.it. lu -ti- ruw 




Not Established 


(Al) to ANS arc 




Not Established 


ULA Upper Lip - 




Not Established 


Lower Incisor to MancL Plane 


86 




Upper Part of Gonial Angle 


53 




Lower Part of Gonial Angle 


72 




Palatal Plane to Upper Incisor 


115 
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Appendix C 

The following describes the tooth labeling conventions used in one 
embodiment of the invention. 

Most General Dentists in the US use this # convention. Orthodontists use this 
convention when communicating w/ the General Dentist (GP) as far as 

extraction, etc. 

This view is as if you are looking directly at the patient's face (Y our left is 
the patient's right, Your right is the Patient's left) 



Patient's Maxillary Right Quadrant 


Patient's Maxillary Left Quadrant 


Patient's Mandibular Right Quadrant 


Patient's Mandibular Left Quadrant 



lisime 



1-32 Adult Teeth USA 1 2 3 4 5 6 7 8 
16 

(Permanent) 



This line represents the patient's midline 
9 10 11 12 13 14 15 



32 31 30 29 28 27 26 25 



24 23 22 21 20 19 18 



17 



Permanent tooth name 


Number 
System 
1 -32 


Maxillary Right Third molar (Wisdom) 


1 




Maxillary Right Second molar (12 Year) 


2 




Maxillary Right First Molar (6 Year) 


3 




Maxillary Right Second Bicuspid (2nd Premolar) 


4 




Maxillary Right First Bicuspid (1st Premolar) 


5 




Maxillary Right Cuspid (Canine) 


6 




Maxillary Right Lateral Incisor 


7 




Maxillary Right Central Incisor 


8 




Maxillary Left Central Incisor 


9 




Maxillary Left Lateral Incisor 


10 




Maxillary Left Cuspid (Canine) 


11 




Maxillary Left First Bicuspid (1st Premolar) 


12 




Maxillary Left Second Bicuspid (2nd Premolar) 


13 




Maxillary Left First Molar (6 Year) 


14 




Maxillary Left Second Molar (12 Year) 


15 




Maxillary Left Third Molar (Wisdom) 


16 





Upper Right 

Quadrant 

1-8 



Upper Left 
Quadrant 
9 - 16 
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Permanent tooth name 


Number 
System 
1-32 


Mandibular Left Third Molar (Wisdom) 


1 7 




Mandibular Left Second Molar (12 Year) 


1 O 




Mandibular Left First Molar (6 Year) 






Mandibular Left Second Bicuspid (2nd Premolar) 


on 




Mandibular Left First Bicuspid (1st Premolar) 






Mandibular Left Cuspid (Canine) 


zz 




Mandibular Left Lateral Incisor 


23 




Mandibular Left Central Incisor 


24 




Mandibular Right Central Incisor 


25 




Mandibular Right Lateral Incisor 


26 




Mandibular Right Cuspid (Canine) 


27 




Mandibular Right First Bicuspid (1st Premolar) 


28 




Mandibular Right Second Bicuspid (2nd Premolar) 


29 




Mandibular Right First Molar (6 Year) 


30 




Mandibular Right Second Molar (12 Year) 


31 




Mandibular Right Third Molar (Wisdom) 


i 32 





Lower Left 

Quadrant 

17-24 



Lower Right 

Quadrant 

25-32 



a - t Deciduous Teeth USA 
( Primary) 



a b 


c d 


e 


f 


g 


h i j 


t 


s r 


q 


P 


o 


n m 



Deciduous Tooth Name 


Alpha Sy 
a - 


stem 
t 


Maxillarv Riaht Deciduous Second Molar (2 Year) 




a 


Maxillary Right Deciduous First Molar 






b 


Maxillary Right Deciduous Cuspid (Canine) 






c 


Maxillary Right Deciduous Lateral Incisor 






d 


Maxillary Right Deciduous Central Incisor 






e 


Maxillary Left Deciduous Central Incisor 






f 


Maxillary Left Deciduous Lateral Incisor 






g 


Maxillary Left Deciduous Cuspid (Canine) 






h 


Maxillarv Left Deciduous First Molar 






i 


Maxillary Left Deciduous Second Molar (2 Year) 




j 


Mandibular Left Deciduous Second Molar (2 Year) 




k 


Mandibular Left Deciduous First Molar 






I 


Mandibular Left Deciduous Cuspid (Canine) 






m 


Mandibular Left Deciduous Lateral incisor 






n 


Mandibular Left Deciduous Central Incisor 






o 


Mandibular Right Deciduous Central Incisor 






P 


Mandibular Riqht Deciduous Lateral Incisor 






q 


Mandibular Right Deciduous Cuspid (Canine) 




r 


Mandibular Right Deciduous First Molar 




s 


Mandibular Right Deciduous Second Molar (2 Year) 




t 
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Other Notations can be used for Missing, Supernumerary (extra) 
, pontics, etc. used after the Number. 



S or s for Supernumarv 



P or p for pontic 



Xorx for missing 
I or i for Implant 
d for deciduous 

Example : 7s = supernumerary (extra) Maxillary Right Lateral 
4X = # 4 missing , missing Max. Right 2 nd Bicuspid 
3 4p 5p 6 = bridge from # 3 - # 6, (#4 & #5 are pontics) 



Most Orthodontists in the USA use the following # convention: 



Patient's Maxillary Right Quadrant 


Patient's Maxillary Left Quadrant 


Patient's Mandibular Right Quadrant 


Patient's Mandibular Left Quadrant 



This Kne represents the patient's midline 

1 -8 in each quadrant - Permanent Teeth USA 

starting w/ 1 in the middle, therefore ALL l's are central incisors, ALL 4's are 
1 st bicuspids, ALL 8's are 3 rd molars (wisdom teeth), etc. 



8 7 6 5 4 3 2 1 



8 7 6 5 4 3 2 1 



1 2 3 4 5 6 7 8 



1 2 3 4 5 6 7 8 



Permanent tooth name 


Number 
System 1-8 
in each 
Quadrant 


Maxillary Right Third molar (Wisdom) 




8 


Maxillary Right Second molar (12 Year) 




7 


Maxillary Right First Molar (6 Year) 




6 


Maxillarv Riqht Second Bicuspid (2nd Premolar) 


5 


Maxillarv Ripht First Bicuspid (1st Premolar) 




4 


Maxillary Right Cuspid (Canine) 






3 


Maxillary Right Lateral Incisor 






2 


Maxillary Right Central Incisor 






1 


Maxillary Left Central Incisor 






r 1 


Maxillary Left Lateral Incisor 






2 


Maxillary Left Cuspid (Canine) 






3 
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Permanent tooth name 


iMumDcr 
System i-o 
in each 
Quadrant 


Maxillary Left First Bicuspid (1st Premolar) 


4 


Maxillarv Left Second Bicuspid (2nd Premolar) 


5 


Maxillary Left First Molar (6 Year) 




6 


Maxillary Left Second Molar (12 Year) 




7 


Maxillary Left Third Molar (Wisdom) 




8 


Mandibular Left Third Molar (Wisdom) 




8 


Mandibular Left Second Molar (1 2 Year) 




7 


Mandibular Left First Molar (6 Year) 




6 


Mandibular Left Second Bicuspid (2nd Premolar) 


5 


Mandibular Left First Bicuspid (1st Premolar 


) 


4 


Mandibular Left Cuspid (Canine) 






3 


Mandibular Left Lateral Incisor 






2 


Mandibular Left Central Incisor 






1 


Mandibular Right Central Incisor 






1 


Mandibular Right Lateral Incisor 






2 


Mandibular Riaht Cuspid (Canine) 




3 


Mandibular Right First Bicuspid (1st Premolar) 


4 


Mandibular Riaht Second Bicuspid (2nd Premolar) 


5 


Mandibular Right First Molar (6 Year) 




6 


Mandibular Right Second Molar (12 Year) 




7 


andibular Right Third Molar (Wisdom) 




8 



a — e in each quadrant Deciduous Teeth USA 
e d c b i abcde 



edcba abcde 



Deciduous Tooth Name 


Alpha Sy 
a- 


stem 
e 


Maxiliarv Riaht Deciduous Second Molar (2 Year) 




e 


Maxillary Right Deciduous First Molar 






d 


Maxillary Right Deciduous Cuspid (Canine) 






c 


Maxillary Right Deciduous Lateral Incisor 






b 


Maxillary Right Deciduous Central Incisor 






a 


Maxillary Left Deciduous Central Incisor 






a 


Maxillary Left Deciduous Lateral Incisor 






b 


Maxillary Left Deciduous Cuspid (Canine) 






c 


Maxillary Left Deciduous First Molar 






d 


Maxillary Left Deciduous Second Molar (2 Year) 




e 


Mandibular Left Deciduous Second Molar (2 Year) 




e 


Mandibular Left Deciduous First Molar 






d 


Mandibular Left Deciduous Cuspid (Canine) 






c 


Mandibular Left Deciduous Lateral Incisor 






b 


Mandibular Left Deciduous Central Incisor 






a 
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Deciduous Tooth Name 


Alpha System 
a-e 


Mandibular Right Deciduous Central Incisor 






a 


Mandibular Riqht Deciduous Lateral Incisor 






b 


Mandibular Right Deciduous Cuspid (Canine) 




c 


Mandibular Right Deciduous First Molar . 




d 


Mandibular Right Deciduous Second Molar (2 Year) 




e 



We use a short hand to diagram individual teeth or groups of teeth, example: 



= Upper Right Quadrant 



= Upper Left Quadrant 



= Lower Right Quadrant 



Lower Left Quadrant 



this short hand is for ALL four 1 st biscuspids 



this shorthand is for the Maxillary Right Central 
Incisor 



this is short hand is for both Maxillary 3 rd molars 



e 


e 


e 


5 



this is short hand for Maxillary Right & Left Deciduous 2 nd molars, 
Mandibular Right Deciduous 2 nd molar and the Mandibular 
Left Permanent 2 nd bicuspid 



6 e d c2 1 



(6), 



1 2 c d e 6 



This is short hand for ALL four Permanent 1 st Molars 



d) 



6edc21 12cde6 ALL four Deciduous 2 nd & 1 st Molars (e & 

ALL four Deciduous cuspids (canines) ( c ) 
ALL four Permanent Lateral incisors (2) 
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Other short hand used UR = Upper Right 

UL = Upper Left 
LR = Lower Right 
LL = Lower Left 



Followed by tooth # (Ex: UR1 = Upper Right 

Central Incisor 



UR8 UR7 UR6 UR5 UR4 UR3 UR2 UR1 


UL1 UL2 UL3 UL4 UL5 UL6 UL7 UL8 


LR8 LR7 LR6 LR5 LR4 LR3 LR2 LR1 


LL1 LL2 LL3 LL4 LL5 LL6 LL7 LL8 



Permanent tooth name 


Number 
System 1- 
8 

in each 
Quadrant 


Maxillary Right Third molar (Wisdom) 




UR8 


Maxillary Right Second molar (12 Year) 




UR7 


Maxillarv Riaht First Molar (6 Year) 




UR6 


Maxillarv Riaht Second Bicuspid (2nd Premolar) 


UR5 


Maxillarv Riaht First Bicuspid (1st Premolar) 




UR4 


Maxillary Right Cuspid (Canine) 






UR3 


Maxillary Right Lateral Incisor 






UR2 


Maxillary Right Central Incisor 






UR1 


Maxillary Left Central Incisor 






UL1 


Maxillary Lett Lateral Incisor 






UL2 


Maxillary Left Cuspid (Canine) 






UL3 


Maxillarv Left First Bicuspid (1st Premolar) 




UL4 


Maxillarv Left Second Bicuspid (2nd Premolar) 


UL5 


Maxillary Left First Molar (6 Year) 




UL6 


Maxillary Left Second Molar (12 Year) 




UL7 


Maxillary Left Third Molar (Wisdom) 




UL8 


Mandibular Left Third Molar (Wisdom) 




LL8 


Mandibular Left Second Molar (12 Year) 




LL7 


Mandibular Left First Molar (6 Year) 




LL6 


Mandibular Left Second Bicuspid (2nd Premolar) 


LL5 


Mandibular Left First Bicuspid (1st Premolar) 


LL4 


Mandibular Left Cuspid (Canine) 






LL3 


Mandibular Left Lateral Incisor 






LL2 


Mandibular Left Central Incisor 






LL1 


Mandibular Right Central Incisor 






LR1 


Mandibular Right Lateral Incisor 






LR2 


Mandibular Riqht Cuspid (Canine) 




LR3 


Mandibular Right First Bicuspid (1st Premolar) 


LR4 


Mandibular Right Second Bicuspid (2nd Premolar) 


LR5 
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Permanent tooth name 


Number 
System 1- 
8 

in each 
Quadrant 


Mandibular Right First Molar (6 Year) 




LR6 


Mandibular Right Second Molar (12 Year) 




LR7 


Mandibular Right Third Molar (Wisdom) 




LR8 



Could also be for Deciduous teeth using URa , LL b, etc. 



Deciduous Tooth Name 


Alpha & numeric 
System 
UR format 
a - e 


Maxillary RiQht Deciduous Second Molar (2 Year) 




UR e 


Maxillary Right Deciduous First Molar 






URd 


Maxillary Right Deciduous Cuspid (Canine) 






URc 


Maxillary. Right Deciduous Lateral Incisor 






UR b 


Maxillary Right Deciduous Central Incisor 






UR a 


Maxillary Left Deciduous Central Incisor 






ULa 


Maxillary Left Deciduous Lateral Incisor 






ULb 


Maxillary Left Deciduous Cuspid (Canine) 






ULc 


Maxillary Left Deciduous First Molar 






ULd 


Maxillary Left . Deciduous Second Molar (2 Year) 




ULe 


Mandibular Left Deciduous Second Molar (2 Year) 




LLe 


Mandibular Left Deciduous First Molar 






LL d 


Mandibular Left Deciduous Cuspid (Canine) 






LLC 


Mandibular Left Deciduous Lateral Incisor 






LL b 


Mandibular Left Deciduous Central Incisor 






LLa ! 


Mandibular Right Deciduous Central Incisor 






LR a 


Mandibular Right Deciduous Lateral Incisor 






LR b 


Mandibular Right Deciduous Cuspid (Canine) 




LR c 


Mandibular Right Deciduous First Molar 




LR d 


Mandibular Right Deciduous Second Molar (2 Year) 




LR e 



International Teeth # System 
1 1 - 1 8, 21 - 28, 3 1 - 38, 41 - 48 International Adult teeth 

Each Quadrant numbered bv 1 st # 

Quadrant I 



Quadrant Jt 



1 = Maxillary Right 
Quadrant 2 

2 =Maxillary Left 

3 .= Mandibular Left 
Quadrant 3 



- 54 - 



SUBSTITUTE SHEET (RULE 26) 



WO 99/59106 



PCT/US99/10566 



4= Mandibular Right 

Then tooth #1-8 

18 17 16 15 14 13 12 11 

28 



48 47 46 45 44 43 42 41 



21 22 23 24 25 .26 27 



31 32 33 34 35 36 37 



38 



International Deciduous Teeth 
Quadrants 5-8 



Quadrant 7 
Then tooth it 1 - 8 



Quadrant 5 



Quadrant 



58 57 56 55 54 53 52 51 



Quadrant 8 



61 62 63 64 65 66 67 



68 



78 



88 87 86 85 84 83 8 2 81 



71 72 73 74 75 76 77 



Permanent tooth name 




Firsts- 
Quadrant # 
second # = 






tooth # 




Maxillary Right Third molar (Wisdom) 




18 


one-eight 


Maxillary Right Second molar (12 Year) 




17 


one-seven 


Maxillarv Riaht First Molar (6 Year) 




16 


one-six 


Maxillarv Riaht Second Bicuspid (2nd Premolar) 


15 


etc. 


Maxillarv Riaht First Bicuspid (1st Premolar) 




14 




Maxillary Right Cuspid (Canine) 






13 




Maxillary Right Lateral Incisor 






12 




Maxillary Right Central Incisor 






11 




Maxillary Left Central Incisor 






21 


two-one 


Maxillary Left Lateral Incisor 






22 


etc. 


Maxillary Left Cuspid (Canine) 






23 




Maxillarv Left First Bicuspid (1st Premolar) 




24 




Maxillarv Left Second Bicuspid (2nd Premolar) 


25 




Maxillary Left First Molar (6 Year) 




26 




Maxillary Left Second Molar (12 Year) 




27 




Maxillary Left Third Molar (Wisdom) 




28 
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Permanent tooth name 


First # = 
Quadrant # 
second # = 
tooth # 


Mandibular Left Third Molar (Wisdom) 




38 


three-eight 


Mandibular Left Second Molar (12 Year) 




37 


etc. 


Mandibular Left First Molar (6 Year) 




36 




Mandibular Left Second Bicuspid (2nd Premolar) 


35 




Mandibular Left First Bicuspid (1st Premolar 


) 


34 




Mandibular Left Cuspid (Canine) 






33 




Mandibular Left Lateral Incisor 






32 




Mandibular Left Central Incisor 






31 




Mandibular Right Central Incisor 






41 


four-one 


Mandibular Right Lateral Incisor 






42 


etc. 


Mandibular Right Cuspid (Canine) 




43 




Mandibular Right First Bicuspid (1st Premolar) 


44 




Mandibular Riqht Second Bicuspid (2nd Premolar) 


45 




Mandibular Right First Molar (6 Year) 




46 




Mandibular Right Second Molar (12 Year) 




47 




Mandibular Right Third Molar (Wisdom) 




48 





Deciduous Tooth Name 




Quadrant 
# first then 
tooth 
letter 


Maxillarv Riaht Deciduous Second Molar (2 Year) 


1e 


Maxillary Right Deciduous First Molar 




1d 


ight Deciduous Cuspid (Canine) 




1c 


Maxillary Right Deciduous Lateral Incisor 




1b 


Maxillary Right Deciduous Central Incisor 




1a 


Maxillary Left Deciduous Central Incisor 




2a 


Maxillary Left Deciduous Lateral Incisor 




2b 


Maxillary Left Deciduous Cuspid (Canine) 




2c 


Maxillarv Left Deciduous First Molar 




2d 


Maxillary Left Deciduous Second Molar (2 Year) 


2e 


Mandibular Left Deciduous Second Molar (2 Year) 


3e 


Mandibular Left Deciduous First Molar 




3d 


Mandibular Left Deciduous Cuspid (Canine) 




3c 


Mandibular Left Deciduous Lateral Incisor 




3b 


Mandibular Left Deciduous Central Incisor 




3a 


Mandibular Right Deciduous Central incisor 




4a 


Mandibular Riqht Deciduous Lateral Incisor 




4b 


Mandibular Riqht Deciduous Cuspid (Canine) 


4c 


Mandibular Riqht Deciduous First Molar 




4d 


Mandibular Riqht Deciduous Second Molar (2 Year) 


4e 
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The following describes a tooth auto-alignment strategy used in the 
clinician/consultant 125/ The clinician/consultant 125 can use the following 
procedure in determining. an appropriate treatment for a patient. 



1. 



Generate tooth alignment template (arch wire). 



Top View 

'"Anterior 




Right 



Posterior 



Left 



Lateral View 



Posterior 



Anterior 



_ „ w . t> 



Tooth Wire Alignment 




Fit tooth ahgnment wire to the 
dental arch 



Establish midline and first 
molar locations on the wire. 
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Set incisors Set teeth #s 1 1 and 21 on 

opposite sides of the midline 
mark for the maxilla and set 
teeth #s 3 1 and 41 on the 
opposite sides of the 
mandibular Midline. 



Set Molars I Set the mesial surfaces of first 




Set other Teeth . Align the remainder of the 



teeth. The mesial contact of 
tooth n to contact distal contact 
of adjacent tooth n+1 except 

for the midline teeth #s 
11,21,31 and 41. Themesial 
contact on tooth #21 contact 
the mesial contact on tooth 
#11. Similarly the mesial 
contact on tooth #3 1 contacts 
the mesial contact on tooth # 
41. 

Space Conflict What to do if there is a space 
conflict, i.e., too much tooth 
mass between the mesial of the 
first molar and the distal of the 
central incisors to fit on the 
wire. 

Option 1. Maintain 
-mesial- and distal contacts 
on the wire but have the 
teeth overlap each other. 
. Produce feedback about 
quantity of overlap (for 
each tooth and combined 
overlap). 

Option 2. Do not allow 
teeth to overlap and do not 
constrain the contact to the 
wire. Produce a best fit to 
the space trying to 
conform to the wire. 
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Molar Interarch Relationships 



Mesiobuccal Cusp of 
the upper first molar 
should occlude in the 
groove between the 
mesial and distal 
buccal cusps of the 
lower 1 st molar 
Mesial Lingual Cusp 
Tip of Maxillary 1 st 
.molar fits into central 

ofossa in lower molar 
Distal Buccal Cusp 

. Tip of Mandibular 
molar first Molar fits 
into Central fossa of 
; UpperVl 51 Molar 
The crown of the 
upper first molar must 
be angulated so that 
its distal marginal 
ridge occludes with 
the mesial marginal 
ridge of the lower 
second molar 



Mesiodistal Crown Angulation 



Mesiodistal Crown Angulation 



Mesiodistal Crown Angulation for Various types of 
upper teeth 



For the occlusion to be 
considered normal, the gingival 
part of the long axis of the crown 
must be distal to the occlusal part 
of the axis. The degree of 
angulation depends on the type of 
tooth • ' ' 




GO El O S 03 CZ1 \Zj[ 
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Labiolingual Crown Inclination 




Tooth Rotations 

None of the teeth should be 
rotated. Rotated molars and 
premolars occupy more space 
in the dental arch than normal. 
Rotated incisors may occupy 
less space than those correctly 
aligned. Rotated canines 
adversely affect esthetics and 
may lead to occlusal 
interferences. 
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If there are no anomalies 
in the shape of the teeth, 
or inter-maxillary 
discrepancies in the 
mesiodistal tooth size, the 
contact points should abut 
in normal occlusion. 



An excessive curve of 
Spee restricts the 
amount of space 
available for the upper 
teeth, which must then 
move toward the 
mesial and distal, thus 
preventing correct 
intercuspation. 
A normal occlusion 
has a flat occlusal 
plane (according to 
Andrews, the 
mandibular curve of 
Spee should not be 
deeper than 1.5mm) 
A reverse curve of 
Spee creates excessive 
space in the upper jaw, 
which prevents 
development of a 
normal occlusion. 
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Appendix E 

The following describes an Roth. analysis that can be performed using the 
clinician/consultant 125 and can be particularly helpful in the tooth alignment 
treatment. 







Occlusal plane 


Distobuccal cusps of lower.first molars (36 and 46) and a midpoint 
between the mesiomcisal edges of #s ; 31 and 41. 


Crown Long axis 


. A line formed between the gingival height of contour and cusp tip for 
the bicuspids and cuspids 




A line formed between the gingival height of contour and *** the for 
incisor teeth 




A line formed between the gingival height of contour and the origin of 
the groove between the buccal cusps on the molars. 


Bracket placement 


Brackets are placed at the mid-crown point on this crown long axis. 
Mid-crown equals a point midway between the height at the cusp tips 
and the gingival height of contour. This is true for all teeth except the 
maxillary lateral incisors (12 and 21). #s 21 and 12 are set o.5 mm 
short of the crown midpoint but the final resultwill have the incisal 
edge of these teeth 1 m short of the adjacent teeth. 


Overbite 


4 mm 


Canine 


To contact point 


Over jet 


2-3 mm 


Canine 


1 mm 
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Ap pendix F 

The following describes the specifications of various embodiments of the 



invention. 



Description of Product Features 





Gephalometiic Module 



This module has been designed to assist with patient analysis, treatment planning 
and patient education for orthodontists, dentists that perform orthodontics and 
oral surgeons that perform orthognathic surgery. This module will provide the 
full range of analysis, modelling and treatment features currently expected with 
all existing 2D software packages. In addition, this module will allow the soft 
and hard tissues to be accurately captured and photorealistically displayed and 
analyzed in three dimensions. Unique algorithms will then be accessed to 
perform a number of functions with the captured data. 




The stock objects will be used for model matching and used as a 
template for rapid conversion of the patient input data to a 3- 
D model. These stock objects will include the jaws, teeth, and 
soft tissues of the face. The stock objects can be constructed to 
represent NORMAL for the modeled anatomy. In addition, 
other stock objects could be designed to provide a closer starting 
point for common types of anatomical variation or pathology. 
These variations may include size, sex and facial form (Angle's 
Class I,n and III). Stock objects will be constructed from a wire 
frame with a relatively small polygon count. The vertices of the 
wire frame can be strategically located to allow for the 
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|l subsequent modifications that will allow for rapid customization 
i to adapt to the patient's input data. In the jaws, the stock objects 
II can have a minimum # of "tie down points" that corresponds to 

I "landmark locations". The nunimum # of tie down points on a 

II tooth may include those that allow for rapid modification in 
M height, mesiodistal and buccolingual width, arid angulation. 

11 The wire frame can be mutable. The wire frame can possess a 
11 logical behavior among the neighboring wife frame, intersects or 
11 vertices. That is, when me wire frame is mutated by the end 
r': user all of the intersects that are changed and their neighbors 
11 can respond in a logical fashion. Landmark groupings can be 
11 able to be segmented and moved to a new location to simulate 
II treatment or growth. The movement of these segmented 
11 landmarks can occur through data input or manual "Drag and 
If Drop," 

I! There can be a method for rapid or automatic registration of the 
II stock object with the input data. The input data can include 
HI photographs, x-rays, a previously rendered patient 3-D data set. 

II The stock objects can have a spatial association with a data base, 
tffi The data base will record the 3-D spatial attitude of the stock 

object and will record modifications of the stock object. The 

III data base will track the landmark locations and any other 
111 changes that relate to the original polygon size and form. 
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Object-Oriented Data 
Base 



This is a feature that the average user of the software may 
not fully appreciate- However, as the framework of software 
design, it has many advantages from MedScape point of 
view, the MedScape product line deals with physical entities 
such as patients and anatomical structures of the face. It 
produces images from these objects, extracts measurements 
and produces models of them. It also produces such end- 
user data products as growth prediction and treatment plans. 
The underlying data structure that can define and relate all 
these entities in a unified fashion is an object oriented 
database. The time spent initially on a framework for 
careful definition of the object classes and their relations in 
such a database will save tremendous amount of effort and 
cost in the following developments. In addition to producing 
reusable computer programs, this approach will facilitate 
definition and integration of the work by multiple teams, 
namely MedScape R&D contractors as currently 
envisioned. 



Typical examples of objects are a patient, a digital image, a 
specific mandible, the 3-D model of a specific mandible, a 
"normal" mandible, a treatment plan, etc. The specific 
instances of these objects are stored in the database as rows 
of various tables, where each table represents the object 
class. Each class is identified by its properties and methods 
(procedures that are applied to them). Each software 
development team will concentrate on specific object classes 
assigned to it with the goal of producing class libraries that 
expose the properties and methods of each object to all 
development teams for final integration. 
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3-D Accuracy 



Although accuracy numbers for the so called "nominal" 
conditions can be provided, the accuracy of position and 
orientation measurements made from one or more images of 
an object can vary significantly depending on a number 
parameters. Some of these parameters are inherent to the 
image sensor resolution and noise which can be considered 
fixed and are determined off-line. However, an even larger 
number of these parameters depend on the geometry and size 
of the very object being measured, and the geometric setup 
of the imaging sensors. These "variable" parameters of 
course mean that the accuracy can not be quoted as a unique 
specification for a measurement system. However, 
theoretical error bounds can be internally computed from 
calibration data, camera resolution, and other system 
parameters for a specific measurement scenario. 

The proposed software will include the necessary models 
and algorithms to compute these theoretic error bounds and 
provide them as part of the measurement results. For 
example in the case of landmark position measurements, for 
each measured landmark the software outputs the ellipsoid 
that represents the error uncertainty in three dimensions. In 
this way the user is given a yard stick by which the accuracy 
of each measurement results can be judged. 

In the case of cephalometric landmark measurements, 
submillimeter accuracy was predicted and to some extent 
experimentally validated by exercising these analytic error 
models. A specific R&D task is to validate the error models 
using more complete experimentation. 



MATCHING 



The starting point for modeling an object from multiple 
images is to retrieve a "stock" or normal version of that 



66- 



99591 06A1_I_> 



SUBSTITUTE SHEET (RULE 26) 



WO 99/59106 



PCT/US99/10566 





object model from the database, and use it as a guide for 
designating the landmarks and traces in multiple views. The 
discrete features measured from the actual images are then . 
used to modify the stock model to obtain the desired object 
model. This process requires matching of the stock object 
model to the actual measurements. The model matching is 
based on a discrete and limited set of features which will 
uniquely define a stock object. The software will be able to 
match the stock model by moving these limited features 
without distorting the model into a different object. 


Image Fidei 






The MedScape software typically operates on high quality 








images. To avoid dealing with large file size, the software 
uses image compression using the highest compression ratio 
for which the required image quality is achievable. The 
image quality is preserved both in terms of being visually 
acceptable, and in terms of completely preserving the 
features that are used for 3-D measurements and modeling. 
For 3-D rendering using photographic texture mapping, the 
resolution requirement of the rendered result determines the 
resolution of images at acquisition time 


SPATIAL 
fi^IBRATION 




The spatial calibration of an image is addressed as part of 
the overall geometric calibration of the system. This 
calibration provides a precise and quantitative model of the 
overall imaging chain including the position and orientation 
of the imaging sensors relative to the measurement 
coordinates, the internal geometry of the sensors, and the 
sampling parameters of the sensor plane to form the final 
array of pixels. Nonlinear transformations due to 
perspective and, when applicable, due to optics are modeled 
and compensated for by the calibration process. 


Improved 

ASSOCIATION/-:- 


Through photogrammetry computations combined with local 
image analysis algorithms, the software automatically 
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establishes correspondence of two or more points used for 
triangulation. This will minimizes the user effort of 
designating the corresponding points in different views 
based on visual cues. This automation is achieved by taking 
into account the geometric constraints imposed by both the 
imaging system and the object being modeled. 



: 7 i: only ho&b$ visual mformction. 
WjsNp depth perception 

Convergence & occommodpHan " 
*r * occur only ct the screen level. 



3D display refers to the mode of 3D visualization on a computer 
screen. The reason MedScape was formed, is to give doctors a 
convenient, fast and user friendly way to gain accurate 3D 
information for diagnosis and treatment planning. Today's 
"state-of-the-art", in orthodontics, orthognathic surgery and 
plastic and reconstructive surgery diagnosis, is two-dimensional. 
True three-dimensional visualization and manipulation of the 
3D data set is essential for accurate diagnosis and treatment 
planning. 

The 3D display allows for the visualization of the 3D data base 
(created from photos, models, X-rays, etc). This 3D 
visualization allows for 1) Perspective 3D viewing with 
shading, shadowing and monocular depth cues. 2) Straight on 
3D Stereoscopic viewing and 3) Ability to view the 3D data set 
in a 45 degree 3D Stereoscopic viewing mode (allows for 
50% more visual information). 
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The 3D display of the 3D data set can include the following 
information: 

1) Display dimensionally accurate representation of the patients 
anatomy, (face, facial contours, teeth, gingival tissue, bony 
anatomy via ceph X-ray or CT, MRI (wire frame 

and rendered), etc.) 

2) A consistent cartesian coordinate system. A right handed 
Cartesian Coordinate System is defined as: Looking at Front of 
an object (ex. front of the face) 

X axis - Horizontal with Positive X to the Right, 

Y axis - Vertical with positive Y up, 

Z axis - In/Out with positive toward the viewer 



R, 3 ht Honded : ; ^ 
Ccrtesion Coordmcje 

System.:: 



1 Right laferol l:Vlew 



kight Hcnded \ " 
Cartesian. Coordinate 
System •:::-• 





Ft6«t View 

: •:. :-y--: : - 



All data sources set to this right handed Cartesian Coordinate 
System. 

3) An X,Y,Z, analog in computer display to aid viewer in 
orientation of 3D data set. For 3D perspective & 3D 
Stereoscopic 

4) Rotation of the 3D Data Set in all 3 planes of space and the 
ability to control the roll, pitch & yaw movements around these 
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axes (6 degrees of freedom). The ability to see the 3D 




data set from any angle or view. 




5) Be able to lock the mouse so the object can be rotated in only 




one axis at a time and in real time. 




6) Be able to easily go back to the original orientation of the data 




set (example - Frontal 'View). 




7) The user can define and control the rotation of the data set 




precisely. (1 degree Rotation or smaller) 




8) The user should be able to define a rotational pattern around 




one, two, or three axes, together or independently. 




9) The user should be able to move the 3D model in real time: 




1. up/down, 




2. right /left, &/or 




3. in/out (Stereoscopic vs larger/smaller or Z buffer) 




10) See any virtual view at any angle Predefined views 1) 




Frontal, 2) Right Lateral, 3) Left Lateral, 4) SMV, 5) 45 degree 




right, 6) 45 degree left, 7) smile, 8) lips in repose vs lips closed. 




(ABO Requirements) 




11) Animation in perspective 3D and in Stereoscopic 3D. 




(Example: open/closed animation to evaluate deviation on 




opening, asymmetry, etc. animate mandibular movements 




associated with jaw tracking). 




12) The 3D display should allow for user controlled 




transparency of facial soft tissue to show underlying teeth and 




skeletal structure relationship. Transparency should be 




controlled by a slide bar from 0% - 100% and have predefined 




20%, 40%, 60%, 80%, for quick acquisition. 




13) Lighting of the 3D data set should be predefined to give the 




best brightness, contract, etc. Real time lighting changes should 




be possible to gain better 3D view. Especially important with 3D 




Stereoscopic viewing on high contrast areas as it gives poor | 




results to the stereoscopic 




effect. In Stereoscopic mode the lighting should allow for the 




Stereopairs to be lighted the same. Eliminate difference in 




lighting of the two separate views , creates ghosting. 




14) A Reference plane should be available to show the drawing 




plane, etc. 
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ThpiKeof 7nnm matrnifv scalins SCt avis SDlit obiectS 




■mrwTf* cpompntc tn'm crracri nhiects should be available and user 








l fi\ Thp software ID nrnpTam should show the wireframe. Quick 




rpndpr and fiill tptiHpt nf the 3D data sel Also render a window 




chmilH Hp availahlp to rpnder nnlv an area of interest. 




17) The 3D Display should use the photographs from which the 




wireframes are venerated to create the Dho to realistic textures. 




1 R , i The camera setting should be predefined Other settinE can 




v»<» inrlnHpH oc crpnp rampT^ director camera nan tilr Roll 




TOnllv etc 




l ON ITi H-icnlaTT allrtw fnr ■imnnrt/exnort of Model files" 




( MHT D"5CF |GS 3DS otherl 




Offt Tmnnrt/P'Ynnrt nf nirtnrp formats" ( BMP TGA. GIF 




TTT7 PPV nther* 




T\\ TKe* Q'TN /1-icnlav cVmnlrl allow fnr "facial tnnncrranhv 
Zl^ 1 nC jj-/ QlSpidy MlUtxlu. ollUW 1U1 lal*lal Lupugio.pi.ijr 




TricnaltTatinn and measurement Facial tonoffranhv contours 




KoirA ^p»T+oin -nattprnc that differ from netrole considered 




"Rpantifiil" vs M Ufflv" vs "Normal" Subtle differences in the 




•tocol orp*> 7"v<wvm?itic area fcheplc hone^ Lin contour submental 




■FrtlH an/1 r»hin arpa Facial tnnnfn^nhv will be more 




pviHent in QterenQConic 3-D visualization. 




"pM-hirpQ that are nQed tn describe beautv* 




1 Phppk" hiah "Flat 

1. L^UCcxL. Illgll Vi3. 171(11 




0 Ohiti* acommptrv nrnminpncp deficiencv cleft 




^ T inc "Full thin nrntnisive retrusive conuTiisure veimilion 




HnrdpT pthnic rnn si derations 




d TMnsp* Sire width flarinff alar base nares dorsal huniD. 




nasal tin svmmetTv nasal cartilat?e deviation 




C Crnila* mimmw /-I a-ft r*if*Tit 1 rv-n fJ 'For'p chf>l*t faCP CVTOTTIPl I V 
J. ollUiC. gUIIUIlY} UCllLiCHL, XUllg la^t, oliUXL latv, ojXixiiit»u.jr 




6. Facial: Proportional thirds, symmetry 




1. eyes: Symmetry, high, low, prominent vs. recessed. 




8. Glabella: Prominent vs. deficient 




9. Ears: Synimetry, size, vertical position, morphology 
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Display 




The human visual system is composed of two eyes with a 
horizontal interocular distance of approximately 65mm. This 
Horizontal offset of the eyes allows for each eye to "see" a 
slightly different view in the "real world". This retinal disparity 
creates Binocular vision in which the brain fuses these two 
slightly different views into a single view with visual depth 
perception. Binocular vision allows for visual and intuitive 
understanding of depth. Convergence of the eyes are controlled 
by muscular effort that sends proprioceptive input to the 
neurological system to help determine depth and position of 
objects. Accommodation (or focusing) of the lens of the eyes 
also presents a proprioceptive mechanism to determine depth 
information. 

Human Binocular vision is also closely associated with 
proprioceptive feedback from the tactile sense (Haptic = touch 
and Prehensile = reach and grasp). 

Retinal disparity is mimicked by creating parallax on the 
screen. Parallax is the horizontal offset of two separate pictures 
of the same scene. Parallax can be controlled to create the 
image behind the screen (positive parallax) 9 at the screen plane 
(Zero Parallax) or in front of the screen (negative parallax). 
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Negative parallax would be the best choice for 3D stereoscopic 
viewing of cephalometric images. 




Stereoscopic 3D imaging allows for all 3 planes of space to be 
viewed, simultaneously. This is a clear and important difference 
between 3D Stereoscopic viewing and 3D perspective viewing. 
When stereoscopic 3D visualization is added to motion parallax 
(such as rotation of the object) there is an enhancement of visual 
depth. 

The 45 degree angular stereoscopic viewing allows the operator 
to view 50% more of the image. This is an even greater reason 
to use Stereoscopic viewing. Again motion parallax (rotation) 
adds even more visual reference. It allows for improved 
visualization of the Z axis information. 

Any 3D visual information can be created in a 3D Stereoscopic 
mode to further enhance to visual ability to understand 3D 
relationships of anatomy. When motion parallax is also added 
even greater visual depth information is present. 

vantages of 3D Stereo vs perspective 3D vs 2D: 
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Once the 3D model is created (patient face, teeth, skeletal 
structure), the software program can create the appropriate 
. "stereo pairs" for 3D Stereoscopic viewing. Lighting 
(brightness, contrast, shadows, etc), can be controlled. The 
software can create the appropriate parallax on the screen to 
create the stereoscopic image on the screen when viewed with 
the appropriate viewing lenses (anaglyph, polarized, field 
sequential). 

In order to view stereoscopically on a computer monitor, one can 
present the two separate images to the corresponding retina in 
each eye. Anaglyph uses Red & Blue lenses so that each eye 
only sees the image it is suppose to see. There is some 
limitation on using colored images with the anaglyph mode. 

Other mechanisms such as polarized or field segmental are 
available. Precise control of the vertical and horizontal parallax 
is criticaL 

Stereo viewing of angular, linear, planes, angles, points, and 
volume is important. 

Full color can be done with anaglyph (synthonics) but problems 
do arise with red, blue and green colors that are part of the 
image. True full color is best seen with polarized or field 
sequential (LCD shutters). Field sequential can be 60 or 120Hz. 
The image flicker can only be eliminated with the 120 Hz. 
Another advantage of field sequential is tracking devices can be 
incorporated to allows the viewer to visualize the 3D scene from 
multiple viewing angles. The multiple viewing angle is an 
advantage over fixed viewing angle required by anaglyph or 
polarized viewing techniques. 


Models i asp Data 
Source . 




The molds of the teeth give a physical model upon which arch 
length and treatment decisions are made. These models can be 
mounted on an articulator or not mounted. The articulated 
mounted models give a more true 3D relationship of the teeth to 
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skeletal reference planes. 

These physical models can be digitized or photographed in order 
to enter the 3D data information to create the model analysis in 
the computer and also as a model to be integrated to the face and 
skeleton from photo & X-ray data sources. 

The voxel view scanner with confetti projector can be used to 
photograph the physical models of the teeth and to create the 3D 
data points for the creation of a wireframe and a 
photorendered model of the teeth for computer manipulation and 
integration to the skeletal anatomy and facial topography. 

A very accurate 3D data set could be made by sectioning, via 
microtome, a copy of the physical molds of the teeth (in 
microns) and taking sequential pictures of the "cross 
sections". These pictures of the cross sections can then be 
combined into a very accurate 3D data set for use as a 3D model 
in computer memory or for storage on CD ROM. 


Data Fusion 


Data fusion allows data acquired through independent input 
devices to be combined (fused) into a single 3-D data base. This 
requires that all input devices be calibrated to allow for the 
creation of "dimensionally true" data. In addition, all data sets 
can be cross-calibrated to use a common 3-D co-ordinate system. 
The device calibration and the cross-calibration of data sets 
should be automatic to facilitate the speed of data fusion. The 
data fusion will occur through the image management system 
(IMS). Independent data sets will have a mathematical, 
geometrical or spatial relationship to each other that can be 
calibrated or related through the process of data fusion. These 
mathematical, etc. relationships will be monitored through the 





-75 - 



SUBSTITUTE SHEET (RULE 26) 

BNSDOCID: <WO 99591 06A1 J_> 



wo 



99/59106 



PCT/US99/10566 





use of the IMS data base. 


FDA Approval 


There has been a push in recent years by the ADA and FDA to 




have all medical devices, including soft ware, FDA approved. 
This approval is not required at this time but is desirable. In 
essence the software can be approved to validate that it can do 
what MedScape claims it can do. The software can provide 
safety features to assure that the patients anatomy is not be 
misrepresented . There should be a record of all digital 
alterations of the original input data. 



Input Da1 

Cephalometric 


:u Sources for Cephalometric Module: . 
The standard cephalometric technique requires a 60 inch 
source to mid- cephalostat distance and a 15 cm from the mid 
ceph. to film plane distance. The beam is projected in the 
horizontal plane and perpendicular to the film plane. The 
cephalostat orients and stabilizes the head through the use of 
ear rods. The standard cephs are acquired from the lateral and 
frontal directions. Standard and non-standard cephalometric 
images can be utilized for MedScape software. Non standard 
cephs can alter any of the above parameters. Calibration 
markers can be used. These calibration markers will calibrate 
the imaging device, be used for cross-calibration of the data 
sets and may be used to calibrate the gray scale. We should 
allow the orthodontists to have output that conforms to the 
standard projections. 


Mci^I Photographs 


Photographic standards have been formed by the American 
Board of Orthodontics (ABO). These standards specify the 
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Photographs 



input device and tlie output (size, orientation and included 
anatomy). For the MedScape product this ABO output can be 
a minimum requirement so that orthodontists satisfy the ABO 
requirements. A 35 mm format has been the industry input 
device standard for years but the ABO has recently allowed the 
use of digital input devices. The output is l A size and includes 
a full frontal face view, lateral face view and a smile view. 
MedScape may require other projections angles in order to 
build the 3-D model but can have the standard photographs for 
orthodontists. These images can be calibrated for color, 
dimensions, and cross-calibration with the other input devices. 




The ABO has extended standards for intra-oral photographs. 
The standard projection angles for intra-oral photographs 
include full frontal with teeth in occlusion, right and left lateral 
projections of the teeth and maxillary and mandibular occlusal 
projections. The output images are at full size (1:1 ratio). 
MedScape may require other projections angles to build the 3-D 
model but can have the standard photographs for orthodontists. 
These images can be calibrated for color, dimensions, and 
cross-calibration with the other input devices. 
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point. CR is used by many clinicians as a treatment planning, 
treatment reference and treatment starting point All of our 
visual input records (photographs and radiographic images) are 
created when the mandible is in centric occlusion (CO). CO 
refers to the 3-D spatial relationship of the mandible relative to 
the maxilla when the teeth are closed in their habitual 
occlusion. The habitual occlusion allows the teeth to achieve 
maximum intercuspation (shortest vertical dimension of 
occlusion). CR may not equal CO and therefore we can be able 
to record both CO and CR jaw positions and mathematically 
convert the input data sets from CO to CR by calculating the 
3D displacement of the mandible. 

Conversion from CO to CR: Acquire digital images obtained 
at one or more visual viewing angles for the face that has 
embedded tracking markers that define the 3-D spatial attitude 
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of the maxilla and another set of markers that define the spatial 
attitude of the mandible. Take one set of images with the teeth 
in CO and another set in CR. The MedScape software tracks ■ 
the maxillary and mandibular markers and will compute the 
relative changes in their spatial location (mandibular 
displacement). The location of these tracking markers can be 
spatially cross calibrated with the cephaiometric 3-D input 
data The mandible can be treated as a right bodyThe 
cephaiometric landmark data that describes the mandible can 
be segmented from the remaining data. . The segmentation 
allows the mandible to be moved within the data set. The 
COt^CR tracking or mandibular displacement data will be 
applied to the cross calibrated cephaiometric data to move the 
mandible to a CR position for analysis and treatment planning. 




Feature Description For Cephaiometric Module 


Landmark ID 


Landmarks can correspond with standard orthodontics 
landmarks, i.e., gonion, nasion, sella, pogonion, etc. These 
landmarks can be located in their normal position on the 
morphologically normal skeletal stock object and can be 
visually evident. These landmarks can be spatially associated 
to each other tlirough the IMS data base functions. The 
spatially calibrated cephaiometric views (H & M Associate 
software) can be overlaid on the stock object. The stock object 
will be customized to fit the cephaiometric data by either drag 
and drop of a stock object landmark to the corresponding ceph. 
landmark (edited in all available projection views) or by 
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digitizing the landmarks on the ceph and then making.the 
association and customization from the stock object through 
the IMS data base. A combination of the two customization 
methods can be used. In addition, non-landmark 
cephalometric data may also be associated with the stock 
objects. The non-landmark data of most interest are the ridge 
crests (j.e., orbital rims, rim of the nasal fossa, external borders 
of the mandible, mandibular canal, sinuses margins etc. 

The stock objects provide a visual reference of the patients 
anatomy and the landmarks are the data base portion of the 
patient's file that describe the features that are unique for that 
individual. Therefore, only the landmark locations need to be 
stored in the IMS data base. The landmark locations can 
serve as a set of instructions for altering the stock objects. 
Similarly, the transmission of patient landmark location and 
customizing the stock object at the receiver is more efficient 
method then transmitting a customized stock object. 
Use the EMS data base to compile landmark location data to be 
used to establish normative data for 3D cephalometric analysis 
and for upgrading the stock model. 


2D Analysis and 2 D 
Normative Data 


A 2D orthodontic cephalometric analysis is based on 
comparison of the patients* data with 2D normative data bases 
that have existed for decades. 2D normative data bases include: 
Burlington growth study, Bolton/Broadbent, Rocky Mountain 
Data Systems, Michigan Growth Study, to name a few. 2D 
analysis include: Steiner Analysis, Downs Analysis, Ricketts, 
Tweed, Alabama, RMDS, Wits, Owens, etc. 2D template 
analyses are normative 2D visualizations that are overlayed 
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over the patients tracing for immediate visual information of 




deviations from the norms. 




Standard deviations from the norm are included in most 




computerized 2D analysis for comparison. One, two & three 




standard deviations from the "norm 1 ' are shown both 




numerically and graphically. 




2D anatomical landmarks of anatomy are well defined in the 




literature and include: Sella, Nasion, Point A, Point B, 




pogonion, menton, gnathion, porion, orbitale, articularie, 




condylion, gonion, etc. 
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LATERAL CEPHALOMETRIC ANALYSIS POINTS 



POINTS SELECTED BY INSPECTION 

A - A Point The tttipm paint on the eurva of 

the Maxilla between the interior 
nasal spina and tha dantat alveolus. 

Em - Embrasure A point where upper and lower 




A1 Incisor 
AR - Incisor 
A3 •• Cuspid 
ANS - Maailla 
B\ - Incisor 
BR — Incisor 
83 - Cuspid 
Ba — Basion 

LL - Lip 
Me - Manton 
N - Naston 



Incisat tip of the upper incisor. 
Root tip of the upper incisor. 
Tip of the upper canine. 
Tip of the anterior nacal spine. 
Incisal tip of the lower incisor. 
Root tip of the lower incisor. 
Tip of tht lower canine. 
Most inferior potter ior point on 



Most anterior point on the lower 
lip (point closest to tha esthetic 
planet. 

A point located at tha lowest point 
on the midline curve of the 
symphysis. 

A point at the anterior limit of the 
nasofrontal suture. 



O - Orbitale A point located at the lowest point 

on tha external border of the 
orbital cavity, tangent to the 
Frankfort plane. 

PNS — Maxilla Tip of the posterior nasal spine. 

Pr - Perron A point located at the most 

superior point of the etxtemal 
auditory meatus, tangent to the 
Frankfort plane. 

S - Sella The center of the sella turcica. 

selected by inspection. 

Pi - Pterygoid Intersection of Inferior border of 
Point foramen rotundum with posterior 

wall of pterygo^maxiltary fossa as 
viewed in lateral head film, 
(Pterygoid Plate). 

Pro - Supra Point selected at the anterior 

Pogonion border of the symphysis between 
point B and Pogonion where the 
curvature changes from concave 
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FRONTAL TRACING (CEPHALOMETRIC POINTS) 




©*3A 

0 AS • Molar 
© 6A 



(D AG • 
0 GA 



Mandible 



FRONTAL CEPHALOMETRIC ANALYSIS POINTS 
CD *A3 • Cuspid Tips of upper permanent canine*. Oeft) 

(right) 

Bilateral points on frontal occlusal 
plane perpendicular to buccal surfaces 
of the crowns ol the upper lirst peima 
nent molari. A6 - left. 6A • right. 

Points at lateral inferior margin of the 
antigoniel protuberances. AG- left. 
GA ■ right. 

Tips of lower permanent canines. <left) 
(right) 

Bilateral points on the occlusal plane 
perpendicular to buccal surfaces of the 
crowns of The lower first permanent 
molars. B6 - left. 6B - right. 

© JL- Maxilla Bilateral points on Ihe juea I process at 
(TT) JR the intersection of the outline of tub en 

osity and zygomatic buttress. JL - left 

JR - right. 



0 B3 - Cutpid 
© 3B 

0 B6 - Molar 
® SB 



© Mt - Menton/ 
Mandible 

0 NC Nasal 

© CN 

0 ZL- Zygomatic 

® ZR 



0 ZA- Zygomatic 
® AZ 

0 AN - Anterior 
Nasal 
Spine 

0 IA ■ Point 1A 



® IB Point IB 



Point on inferior border of symphysis 
directly inlerior to mental protuberance 
and below center of trigonium mentali. 
Points on the outline of the nasal cavity 
at ihe wklest area in frontal perspec- 
tive. NC - left. CN • right. 
Zygomatic Bilateral points on the medial 
margin ol the xygomatico-trontai suture, 
at the intersections of the orbits. Zl ■ left. 
ZH • right. 

Zvgomatic-Center of the root of the 
zygomatic arch, mid- points. ZA left. 
AZ - right. 

Tip of anterior nasal spin* just balow 
the nasal cavity and above the hard 
palate- 
Selected at the interdental pappiiia of 
the upper incisors at tne junction of 
crowns and gingiva. 
Selected at the interdental pappiiia of 
the lower incisors at the junction of 
crowns and gingiva. 



* In all groups of two. the lirst entry indicates left, the 
second indicates rrght. 



MedScapes software can provide all 2D landmark 
identification, 2D analysis, & 2D growth predictions. Because 
the orthodontists wants this information for comparison to 
"traditional" cephalometrics. 

(See section on landmark ID). 

In traditional 2D analysis, all bilateral landmarks are averaged 
to the midline and are created at "standard" magnification due 
to the projective displacement of the object image (patients' 
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head) to the X-ray film. 

These "errors" can be reproduced when the 3D data is 
converted to the "traditional" 2-D data set for comparison to 
"traditional" 2D normative data. The 2D normative data can 
be adjusted for sex, age, race, size, etc. and created into a 
graphical representation (template) of normative data for visual 
comparison. 


3D analysis & 3D 
Normative Data 


MedScape was founded on the premise to create, develop and 
offer 3D & 3D Stereoscopic software products to the medical 
and dental professions. MedScape products will give the 
doctor the ability to diagnose and treatment plan their patients 
with three-dimensionally accurate models of anatomy (face, 
teeth & bones). 

Three dimensionally accurate analysis and normative data 
critically depends on the accuracy of anatomical landmark 
location & identification. 

** (See landmark ID) 

A 3D visual comparison to 3D normative data adjusted for size, 
sex, race, and age. 

3D Normative Data - This data will have to be developed 
through University research as this information is limited at 
this time. Grayson's arcticle in the AJO describes some 3-D 
growth patterns. Also Rick jacobson gives some 3-D data in 
Jacobson's Book "Radiographic Cepahlometrics". At this time, 
3D analysis will have to be "projected" to a 2D format to 
compare to "narrative 2D data" since this is what exist at this 
time. These is some work being done in Australia and Canada 
on 3D MRI & Ceph data. 

3D Analysis of Patient Data - The traditional 2D landmarks, 
angles, planes, etc. can be viewed on the 3D model for 
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comparison. The 3D model will add the advantage of being 
able to view asymmetries of the right & left side of the face, 
teeth, and skeletal structure. This is a critical area that is not 
assessed in "tradiuonal" 2D analyses. 

** ( See Highlight Abnormal) 

Centric Relation & centric occlusion will also be viewed in 3D. 
** (See CR) 

** see segment landmarks 

** see convert to CR 

** see meas. of soft tissue 

** see fuse w/ ceph 

** see output from photos 

** see landmark tracking over time 

** see compute angles 

** see compute distances 

The lingual concavity of the upper and lower incisors are 
related to the disclusion angle and the angle of the eminence. 
These should be congruent w/ each other. These functional 
components of TMJ function and dysfunction are important 
concepts that are critical for proper diagnosis. 3D analysis 
includes modeling of the critical anatomical areas & for the 
generic wireframes to adjust to overlay the patient's anatomy. A 
visual representation of "normal" can be overlayed over the 
patient's "abnormal" for direct comparison 




The doctor will want to customize their analyses to include 
parts of various 2D & 3D analyses. 

The doctor can define which components of each to include. 

MedScape will allow the enduser to define, name, save and 
employ a custom analysis. This analysis can be implemented 
as a macro function. 


^Jro wth Forecasting 


Growth forecasting has always been a goal of cephalometric 
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diagnosis and treatment planning since the early days. It 
became popular with Ricketts introduction to RMDS growth 
forecasts. 

2D growth forecasting has had limited value. Short term 
forecasting has been acceptable at times, but long term 
forecasting has been inaccurate. 

Rocky Mountain Data Systems (RMDS) in association w/ Dr. 
Bob Ricketts have the most extensive data base on 2D growth 
forecasting. 

Lyle Johnston has developed a template that estimates "normal" 
growth "averages" in children. 

Also the Burlington Growth Study is also available along with 
the Broadbent/Bolton study, Michigan study, & others. All of 
these are 2D. 

3D growth forecasting is yet to be developed and will be a 
critical area of study and development. 

** see highlight abnormal 

** see seg. Landmarks 

** see landmark tracking over time 


Visual Treatment 
Objective & Surgical 
Treatment Objective 


** see segment landmark groups 

A visual representation of a treatment plan that a Dr. decides 
from using study models of the teeth, X-rays (Ceph, Frontal, 
Pan, etc.), and photographs of the face & teeth. 

The integration of the 2D ceph with 2D video imaging is now 
"state of the art". Some attempts have been made to have soft 
tissue change in relation to changes made to the bones & tooth 
movements, but are only in 2D (video-ceph integration). A 
more important treatment planning tool would be to evaluate 
the soft tissue changes the Dr. & patient desires (in 3D) and see 
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what changes NEED to occur in the teeth and skeletal structure 




to accomplish this soft tissue change. 




** see also VTO (implants) 




STO - is a Surgical Treatment Objective 




This would be a surgical simulation of the movements of the 




bones and soft tissue to accomplish what orthodontics alone 




cannot achieve. 




** see also Surgical planning (implants) 


Orthodontic 


A sequential set or pnotograpns 01 me xauc, iccui, guigivcu 


Cooperative 


tissues with tracking markers could allow the Dr. to track 


Evaluation & 


COOPERATION in areas of: 


Time line tracking of 


1. Mechanotherapy 




2. Oral hygiene 




3. abnormal growth 




4. abnormal reaction to forces 




5. other 




Time line tracking would allow the evaluation of progress over 




time. Patient's ALWAYS ask "When am I getting my braces 




off". Accurate 3D evaluation of cooperation and growth or 


- 


surgical plans with photos would be a GREAT stride forward. 




Goals of Software: 




Assess Treatment Progress: 




a. Exceptional 




b. Good 




1. On Schedule 




2. Ahead of Schedule 




c. Fair/ behind schedule 




d. Poor/ Delayed 




Reasons for Progress Assessment: 
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i Pnnr Oo-oneration 

d. XUUl \~*\J VJfJwi. Cl.l_l.uil 




1 Head Gear 




9 Elastic 




^ Removable AorjliarLce 




4. Patient disinterest 




5. Other 




b. Missed appointments 




c Broken Annliances 




d. Lost Appliance 




i» Adverse Rioloffical resnonse 




f. Unexpected complexity of case 




*r Other 




Modification of treatment based on Progress assessment and 








a Tn tippH rvf Taw Surperv U/L both 




h TMT Jsnr^erv R/L/B 




c. Extraction considerations 




H Parent Consult 




1 Modifv Treatment aoDroach 




2. Alter Fee 




3. Stop Treatment 




4. Other 


AUTO DETECTION 
CEPHALOMETRIC 

MndiviArks: p; 


Through automated local image analysis, the software 
simplifies the operator task of designating landmarks and 
traces. For example when tracing an intensity edge in an 
image, as long as the user maintains the pointer in the 
general vicinity of the edge, the software automatically 



- 88 - 



SUBSTITUTE SHEET (RULE 26) 

BNSDOCID: <WO 99591 06A1_L> 



wo 



99/59106 



PCTAJS99/10566 





finds the edge and traces it without relying on precise 
pointer movement by the user. 




Generic Presentation: To demonstrate possible treatment 
options, patient education about orthodontics using a generic 
patient. 

Custom Presentation: Demonstrate possible treatment options 
and outcomes using the patient's 3D anatomy. 
Take Home Presentation: Create a limited software program 
that will display a 3D model of the patient with the ability to do 
some minor enhancements (smile data bank). Output-* floppy 
disc, video tape. 


4; reh l^eiigthi Analysis ; ij 
and !ibath Size 
Discrepancy Analysis 


Arch length analysis is a critical diagnostic measurement, as it 
can determine diagnostic decisions of extractions of permanent 
teeth to correct certain orthodontic problems vs. non- 
extractions decisions. The teeth can fit within the supporting 
bone (alveolar bone) to the upper and lower jaw structure. The 
alveolar bone is the supporting bone that surrounds the roots of 
the teeth. The basal bone is the main supporting structure for 
the jaws. 

The basal bone of the lower jaw (mandible) is limited in size by 
its genetic potential and has limited ability for growth 
modification. There are possible growth modifications 
procedures, such as Functional Jaw Orthopedics that have some 
limited growth modification potential. The basal bone 
supports the alveolar bone which supports the teeth. The 
alveolar bone has the potential for adaptation to the positions of 
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the teeth and can be modified as long as the teeth are kept 




within the limits of the basal bone. 




Thp nnnpr i;iw fmaxilla^ has the caDabilitv of increasing its 




tronrrrorrp /^im P»n CI OTIC trio "foniH Pfllat.Jil Expansion" 
XranSVCxoC UlIllCllolUllo Via I dpiu J. aiauu j^Apcuuiuu 




nnniianrpc Thpcp tvnpc nf nrthrvnedic annliances not onlv 




rKanap thp* qIttqoI r>T Knnp chime and the ^i^e but can also 




i~h5»n<jp thp Hi mention nf the maxillarv basal bone dimension 




due to "sutures" that exist in the upper jaw. The lower jaw 




does hot have sutures associated with the mandibular skeletal 




stniciure. 




The maxilla is therefore capable of being increased in size to 




allow for more room form crowded or crooked teeth to be 




oli rm**rl trttn " nnrm ci 1 " nr*f*1licnl fit 
aUSnCO 1I1LU IHJIlllcLl ULUUiol uu 




"Pvt-ra/^tinn \/c nnn-pYtrp ptifin nf "nermanent teeth the decision 




for a surgical solution (adult) vs. growth modification (child) to 




resolve "Arch Length" problems is a major diagnostic decision 




tnat tne oruiOQoniist ano/or wi<n ouigcuu tan uiaivt. 




"FTvtT-Qr^inTi vc noTi-PYtrartinn nf decisions have traditionallv 




"hf»*»-n Kacp/l on thf» cnarp Tprmirements of the mandible due to its 




-irtoKiiitv tn oHqti ctpH Qianifip^Titlv Significant arch 

UldOllllY Itl Uw IfliilllgCU alglllll^oUiLXj • ^J^5 <UW1 




discrepancy in tne lower arcn may require CAUdtuun ui ^cic^lcu 




permanent teeth to resolve the crowding problem, the 




orthodontist can then decide which teeth can be removed in the 




upper jaw, if any, to create a "normal" occlusal fit of the teeth. 
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The teeth can fit into this ideal occlusion when the mandible is 




in a or uvj posiiiorL 




•T^t,— n, ir », p rt f c npp oriH thp Oiirvp nf Wilson are three- 




/ii"Tn*»r»cir»Tial rplatinn shins nf the nlane of occlusion when 




, 7 - frrvm thp latpral anH frnntal nlanes resDectivelv The 

VieWSCl i.1 will L11C loLCldl ollU llUlluli piauuj iw^wwu»vij. & aiw 




«««1ttpop nf thoco -r*»1ati/vncVnr»c of thp tppth also are included in 

anaJySCS OI LllGSG ICldUUIlilllLJo Ul lk>ui <xio\j mo iiibiuu^u 




+ 1_ ^ /1a/«irinn molriTicr TvrOf*^CC f>f t P OT*t tin/i Ont"l St ?} C fjlf aS tjl6 
LLlC QeClSlUIi. UlaKJIlK piUUCoa Ul LLlC UllUUUUiUUl <*o ^ai oa "iw 




avfm/^inn Trc n n« -f»viTQ r"ti nn treatment decisions As the 




r^\tnrf>c "i#»Tff»l" rtut thp tppth rnnld he nnsitioned where there is 




no bone support leading to periodontal (gum) problems. 




Recession and/or alveolar bone loss could occur if not properly 




controlled mechanically. 




in orrt#»r for thp tppth tn "fit" normallv at the end of treatment. 




thp Hnrtnr ran pvalnate ALL 3D reauirements of each arch, 

| | ICS t |t ILii.H I wall wVALUdlv fi 1 ll ' ~s l^v^uiiwinwiiuj wj. v» ■ w» » J 




TMJ, bone configuration, etc. These include: 1. the sagittal 




dimensions (length), 2. the transverse dimension (width), and 




j . luw V CI llLicLL UllllCllDluii iiiwigiiL/. 




Hontoi p-i'tr'i r-i t r\n mTtrnpncjitinns can h£ acconTDlished in order 

UCLlXjil CAUdwllUll wUJll|JGlloa.llUlio Ltui ab^v/iiij ; /iii9i*.s<u wa.v«wa 




to treat a case wruioui aiirgciy ui uicjdw su u^iui nua 




/*ATYinrAmicAH i~rp»Q"t~m pnt at timpQ mflv he accentable for natrents 




who will not accept the surgical treatment alternative or for 




medical or other reasons are not candidates for orthognathic 




surgical procedures. 
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T7\r**h Fiicnr»Tion/-v Thp ci7R of the individual teeth as 




th**rr «arf» nncifrirvnpH arrvnnd the "C^aternarv" tVD6 Curve of the 




o*-r«H tolr#» ii -nn cn^rp Thp rplafive sizes of each tooth tvne 




fm013TS, OlCUSpiUS, CUSpiaS, lIll^loUl £> i uiu u& AiiLtiitixiLtu 




.--^n-infal,, i^t- thp rt^rlnctrm r\f thp TPPth Will Tint fit TiTOnerlv 

anpropriaiery or ins occiubion ui mo iccm wm «ui ail pujp&njr 




ot thp #»nri nf tTpatmpnt Tf a discrenancv exists in the relative 




sizes of certain teeth in the arch, then a so called "Bolton Tooth 




Size Discrepancy" exists. This tooth size discrepancy can also 




a-fFar* tKo -ft* rt-F the* or-rO-n c-irxn hpfu;ppn thp nrvno<Hn arches 

eneci trie rrt oi uie occlusion uciwccii liaw up^» using aiwiiwo. 




t+ ic h^pccqtv to Unu; thp mp<:ia1/di stal Huccal/Iini?iial height 




measurement, along with the root lengths ofthe individual 




teeth. The root length related to biomechanical tooth 




movement considerations. 




Prtitnn trurffi ci7P HicrrpTiriTipips are created when there is a 




micmntch in the siyp of teeth within the resoective arch. This 




y-~r-a«-»+c»r> o -rvr/>l"»l <*tt» r\f oil fniTTIPTlt CJTld T»mnP'T fit Of thp HCClllSIOn 

creates a prooicm oi cuikiiiiicul <ulu jjAup^x ail v/j. uiw uvwuuivn. 




t/' t-t rr thocp Hi pomnonripc nririr tr% rrpatmpnt is critical for 




/w^lin/lATi'fl^ /liinnncic T i m 1 1 ot 1 nnC 1 Tl rfPatTTlPTlt TIPPd tfl Dft 

orxnocionxic oiagnosia . jjiiiiiixiLiuiio ui ucaunt/iu uttu iu 




rolotpH tn thf» r»Qtip-nt qc anarf nf their informed consent Small 

iCiaiCCI IXJ Lilw UdllwIlL do dUoA I UA 14. It'll llLLUliiivU UWllO^l ll. uiiuui 




Intornl in/«irnrc n^tinrm a 1 chartP Jtf fViTTTl CfmP'Pnital ahSPnCe STC 

lateral incisors, aunoi max aiuipc oc iuihi, ^un^tiuuu duauii^-w aiv 




o -fi»ix/ Tfrrthlpmc ihat prpatp a enmnromised end result 




Restorative dental procedures to correct some of these 




discrepancies, need to be planned prior to treatment so the 




patient will be informed and expect follow up care. 
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ortnciHpniinn in nrthnHnnti r* thprariv N4anv elaborate treatment 

COXliilClCl ClLlUll 111 Ul LllULlUllLlt* Ulfciapjr . xvxeiiiT vxauuidi^ uwauuwiv 




alternative have been devised to control relapse. The ability to 




three-dimensionally diagnose and treatment plan a patient may 
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llXipOlXant do LO ULC CVCllLLlcLl 1.1 lieu ivouil uiw y^uuoiuii. 
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i^rxnoQoniisi usuaiiy n<iu.cii uicac umvco uuiiug litauuwii iui 




occlusal correction, upxignting me i^uxve 01 wiiiuii u<±ii icau 




to increaseo axen iengLu dmu neip tu gain opaut iui uuwu^u 




+ «— » +r\ 4l-ta li— ni* rv-f +h/=» ' o1t7*»o1 HfYflP PHTtl P 5ll Hone 3X1Q 

teem, Up tO llie 1111111 Ol ULC alVCUial uuuc, uuiu^ai isuxixs, 




u„ P rti u nri a t p,,a]; n rr fkp Outvp nf ^tipp i*: a routine orthodontic 
pasaj oone. reveling inc v^mvc ui opww xa <x iuuuuw uiuiwuwuuw 




v.4<-kxYio/-Vto-nir-oi offv— r nf tTpatmpnt Thi^ lpad^ to a better fit of 
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tne occlusion wnen ine v^iirvc ui opec 10 icvci&u. x mo 




«BMrln t/t Gannon oli rrV^flTf TT/i'tli aap CO ArthnH ATTtn CtC rOlltlTieiV 

tenus to ueepen siigntiy wilii age, uiuiuuuiLtidio luumi^n 
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the arch. By using the X. Y and Z coordinates of the occlusal 




surfaces of the teeth, a calculation of the arch cirairnference 




can be determined. The distance between any 2 points, A 
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(xi,yi Zi) & B(x 2> Y 2 Z2) in space is the magnitude of the vectors 
connecting them and is give by: 

AB — (Xj-XO' + CY^YO' + C^-Z!) 2 

Each tooth coordinate measurement represents a point in space. 
The total arch circumference is the magnitude of the 
summation of all vectors connecting their points and given by: 
Q " (XrXj) 2 + (Yi-Yj) 2 + (Z r Zj) 2 

Q represents the total arch circumference in 3D space and N is 
thenumber of teeth measured. 

To compare to 2D relationships, the planer projection of the I 
total arch rircumference is calculated using a similar method 
except the depth coordinate (Zi) i.e., depth of Spee is excluded. 

Cp = (X r Xj) 2 + (Y r Yj) 2 

Cp represents the planer projection of the total arch 

circumference to a lateral 2D projected view. 




An asymmetry analysis defines the morphology differences 
between the right and left halves the mandible, maxilla and 
other regions of the skeleton. The symmetry of these structures 
should be determined through the use of landmark groupings. 
The procedure may include determination of the sagittal plane 
midline of the patient by utilizing identifying midline 
landmarks. The sagittal plane midline can be used to define 
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the right and left halves of the patient. 




The simplest symmetry analysis wouiu oe oegin wiui uie 




superimposrtion or the ngnt and iert naives oi me manaiDie 




utilizing the sagittal plane midline reference as the registration 




plane. The quantification of the asymmetry would be to 




compare the x,y,z differences in location of the corresponding 




right and left landmarks ana to compare me locauon or uiese 




landmarks to the normal landmark location (by standard 




deviation). This type or analysis wouia aiiow xne ena user to 




quantify the amount of asymmetry ana airect tne ena user xo 




etiology of the asymmetry. For example, when the mandible is 




asymmetric then it is safe to assume that one side is too small 




or the contralateral side is too large. Comparison of the patient 




nata witii normal data woulu alio w xne clinician 10 uclciilllilc. 




which side was abnormal. Knowledge of the etiology of 




asymmetry may be critical in controlling or predicting the 


• 


outcome of treatment. 




Additional analysis may mcruae a normalization oi uie d-u 




data to the standard ABO 2-D views and performing an 




analysis using existing analysis models. Tools may be created 




to allow the end user to create a symmetry analysis. 




The spatially calibrated cephalometric views can be overlaid on 




the stock object. The stock object will be customized to fit the 




cephalometric data by either drag and drop of a stock object 
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■ 


landmark to the corresponding ceph. landmark (edited in all 
available projection views) or by digitizing the landmarks on 
the ceph and then making the association and customization of 
the stock object through the IMS data base. A combination of 
the two customization methods can be used. In addition, non- 
landmark cephalometric data may also be associated with the 
stock objects. The non-landmark data of most interest are the 
ridge crests (i.e., orbital rims, rim of the nasal fossa, external 
borders of the mandible, etc. These same methods may be 
employed for other stock objects, such as, the teeth, TMJs etc. 




The stock objects are a graphical representation of normal. 
These normal values for landmark location have been 
determined through an analysis of the landmark locations on 
many patients (Burlington study) and have been sorted by age 
and sex of the patient. Deviations from normal can be analyzed 
and statistically grouped as a standard deviation from normal. 
Through the use of the IMS data base we can define normal 
and the standard deviations from normal for individual 
landmarks and landmark groupings. 

Following the completion of the customization of the calibrated 
cephalometric projections to the stock object the IMS data base 
will perform an assessment of landmarks locations and 
groupings of landmarks by compare the patient data to normal 
data through look up tables (LTJT) contained in the IMS data 
base. After this analysis the computer can highlight in color on 
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the customized stock object the landmarks or landmark 
grouping that deviate 1 or more standard deviations from 
normal. A color can be assigned to indicate the severity of the 
deviation (1,2 or 3 standard deviations). This will be a very 
visual method for the end user to identify the locations of the 
abnormal growth patterns and to convey this information to 
the patient or colleagues. This analysis can serve as a basis for 
treatment planning and save the clinician time by achieving a 
rapid analysis and an easy method for patient communication. 
No look up tables are required by the doctor. 


Segment Landmark 
Groups 


Landmarks groupings (3 or more landmarks) can be used to 
describe the size and location of an anatomic structure relative 
to the remaining structures. The segmentation of these 
grouping allows them to be treated as objects. These landmark 
groupings are used in analysis of facial growth, development, 
temporal monitoring of growth and development, 
superimposition of serially acquired data sets, growth 
forecasting and creating visual treatment objectives. The 
MedScape software can have a standard set of groupings that 
match existing groupings. These current landmark groupings 
can be extended into the 3-D domain. In addition, the ability 
for the end-user to define additional groupings can be available. 






In order to convert CO to CR requires digital images at two or 
more visual viewing angles for the face that has embedded 
tracking markers that define the 3-D spatial attitude of the 
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maxilla and another set of markers that define the mandible. 




One set of images are obtained with the teetn in LU ana 




another set m CR. The Medocape sortware will xracK ine 




maxillary and mandibular markers and will compute the 




relative changes in their spatial location relative to each other. 




The location of these tracking markers can be spatially cross 




calibrated with the cephalometric 3-D input data. The 




cep halo metric landmark data that describes the mandible can 




be segmented from the remaining data. The CO->CR tracking 




data will be applied to the cross calibrated cephalometric data 




to move the mandible to CR. 
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Appendix F 

The following describes alternative embodiments of the invention. 
The problems: 

Accurate 3 dimensional models are not available to all segments of medicine 
and dentistry because preferred image acquisition tools may not provide data in a 
format that is easily converted to 3D. When considering 3D techniques the data 
density is so great that it requires special platforms for data handling and 
complex algorithms for data reduction. User interface, etc. 

Summary: Three basic imaging software modules (Sculptor, Clinician and 
Executor) comprise the Acuscape suite of software designed for the medical use. 
These software packages are further customized with application specific 
software to provide benefit to specific medical and dental disciplines. In 
combination these three software packages and associated application software 
produce spatially accurate 3 dimensional replicas (.pro file) of patient anatomy 
that allow for the extraction of clinically relevant data, .pro file manipulation, 
storage, measurement, modification and display for the purposes that include 
diagnosis, treatment planning, treatment simulation and outcomes measurements. 
The Sculptor is used at an image processing center (server) and passes the 
acquired images and measurement files (.scl files) to the Clinician user (client) 
■ for the generation of the .pro file and subsequent use. 
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Sculptor Module: Images are acquired directly into a patient session file 
from input devices that include digital cameras, flat bed scanners, x-ray sensors, 
etc. or from image storage files. An Acuscape image calibration frame is 
worn during image acquisition and shadows of the calibration markers are 
embedded on the resultant images. 

The images are first spatially calibrated and a patient centric co-ordinate 
system is transferred to the images! This co-ordinate system is adjusted or 
optimized to best fit the patients anatomy. Part of this adjustment superimposes 
the y-z plane of the co-ordinate system to superimpose on the patient's mid- 
sagittal plane. The subsequent measurements store data utilizing this 
constructed co-ordinate system. The calibrated images can be stored by the 
executor or displayed and measured. Multiple images or image sets, can be 
combined in a common 3-D database, displayed at as a combined set and can be 
selectively enhanced for improved measurements. These enhancements include 
magnification and equalization of selected image regions. Three space 
measurements can be performed as point, closed loop trace and linear trace 
measurements. The measurement routine occurs simultaneous on all images 
displayed in the sculptor. The selected image is measured and a corresponding 
epipolar line is constructed on the adjacent images to assist with locating the 
same point on that image. The z,y and z locations of all of the measurement 
points and lines (series of points) are stored in a measurement file. The 
measurement files are converted to an export file that contains all jpg images 
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and a .scl file. The .scl files contain the calibration information, camera 

parameters and the x,y and z locations of all traces and landmarks. 



The sculptor facilitates the measurements on all calibrated or cross calibrated 
images. Cross calibration refers to calibrating multiple images and image types 
to the same 3D co-ordinate system. These images can include but are not limited 
to x-rays, tomographs, CT scans, visual band images, MRI, ultrasound, infrared 
and radar. The image type and projection angulation will be dictated by the 
intended purpose of the imaging study. This is an application specific program 
that has been optimized to facilitate the original imaging goals. The Sculptor 
will be used to calibrate and measure the images (spatially, color or gray scale 
value). 

Executor Module: This module works in the background to manage images 
for the Sculptor and Clinician modules. This is a patient centric relational data 
base with multiple tables that stores, retrieves and transports patient image files. 
Patient file transport files contain the .jpg images and an .scl file. The .scl file is 
created by the Sculptor and transported to the Clinician by any number of means 
including modem, internet and floppy, etc. 

Clinician Module: The module is intended to exist primarily in the doctor's 
office (end user). The Clinician will receive the transport file from the Sculptor 
via the Executor. The patient specific measurements contained within the .scl 
file are used by the morph editor, a sub-section of the Clinician, to morph a 
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"stock model" to spatially match the patient's measurements. The "stock 
model" is a generic wireframe representation of the anatomy to be modeled. The 
measurements include specific linear traces, closed traces, landmarks and control 
points. The measurement locations are pre-programmed into the Sculptor and 
the corresponding locations are programmed to the corresponding points on the 
stock wire frame of the Clinician. For example, the orthodontic application 
includes traces of ridge crests (orbits, mandibular borders, etc.), landmarks 
(nasion, Sella, etc.) and control points (tooth cusp tips, etc.). These 
measurement locations and names associated with their precise locations on the 
"stock model" are contained within the Clinician's database. The Clinician's 
knowledge of the precise wireframe vertices associated with the locations of 
landmarks, traces and control points facilitates the automation of using the .scl 
file to morph a generic stock model to a patient specific model (.pro file). 

A specific .pro file can be retrieved via the Executor and displayed, analyzed 
and manipulated as a solid model in the Clinician module. The .pro file will exist 
as a collection of anatomic "objects". These objects will include anatomic 
structures, such as each tooth, landmarks and reference planes. The spatial 
location of all objects are known and tracked by the Clinician's database. The 
.pro file possesses an x,y,z co-ordinate system referred to a the global co- 
ordinate system while each object possesses its own co-ordinate system referred 
to as a local co-ordinate system. The Clinician's database is monitoring the 
spatial location of the .pro file and its sub-objects via their co-ordinate locations. 
The .pro file and/or any of its objects can be translated or rotated along their co- 
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5 anatomic locations of the patient, and for generating a 3D patient specific 

6 model from a stock model using the related anatomic locations. 

1 8. The computer apparatus of claim 7 in which the module creates a data file 

2 containing patient specific information for transfer to another module. 

1 9. A computer .apparatus comprising: 

2 a computer having a processor and memory; and 

3 software for execution on the processor, comprising a module for receiving 

4 patient specific images and patient specific information, the software 

5 having access to a generic three-dimensional model, the software for 

6 customizing the generic three-dimensional model using the patient 

7 specific information to form a customized three-dimensional model of at 

8 least a portion of the patient's anatomy. 

1 10. The apparatus of claim 9 in which location of one or more particular three- 

2 dimensional model vertices is changed in accordance with the patient specific 

3 information. 

1 1 1 . The apparatus of claim 1 0 in which the locations of other three-dimensional 

2 model vertices are changed to be conform with the change in location of the 

3 particular three-dimensional model vertices. 

1 12. The apparatus of claim 9 in which the generic three-dimensional model 

2 comprises a plurality of objects each having an individual object coordinate 

3 system referenced to a model coordinate system. 
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1 13. The apparatus of claim 12 in which the software further comprises a three- 

2 dimensional model viewer capable of manipulating the objects individually or 

3 collectively. 

1 14. A method of capturing and handling medical images, the method comprising 

2 the steps of: 

3 mounting a calibration frame on a patient; 

4 capturing images of the patient and the calibration frame from different 

5 perspectives; and 

6 storing images from a patient resulting from a plurality of sessions in 

7 respectively separate portions of a file management system so that all 

8 patient related data is available in a single entity. 

1 1 5. A method of processing medical images comprising using corresponding 

2 points on different images of a patient to establish a patient centric coordinate 

3 system with respect to which a three-dimensional model is referenced. 

1 16. The method of claim 1 5 in which the corresponding points are determined 

2 using images of a calibration target. 

1 17. The method of claim 16 in which images of a calibration target are 

2 determined using blob analysis. 

1 18. The method of claim 1 5 in which the corresponding points are used to 

2 identify the location of a calibration target in three-dimensional space. 
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1 19. The method of claim 15 further comprising the step of referencing points on 

2 the medical images to the patient centric coordinate system. 

1 20. The method of claim 15 further comprising the step of modifying the 

2 location of particular points on the three-dimensional model to correspond to 

3 patient specific information and morphing the three-dimensional model to adjust 

4 the locations of other points correspondingly. 

1 2 1 . A method of analyzing patient images comprising the steps of: 

2 identifying one or more anatomical locations in a plurality of patient images 

3 from a particular patient imaging session; 

4 determining anatomical locations information in a relative to a reference 

5 frame established from the plurality of patient images; and 

6 using the anatomical location information for patient treatment planning and 

7 execution. 

1 22. The method of claim 21 in which an anatomical location is identified by a 

2 plurality of points constituting an outline trace of the a portion of the patient's 

3 anatomy. 

1 23. A method of identifying corresponding points in a plurality of images which 

2 constitute different views of a three-dimensional space, the method comprising 

3 the steps of: 

4 determining a common reference frame for the plurality of images; 

5 selecting one point on one image; 

6 generating a line through that point; 
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7 displaying a projection of the line in at least one of the other of the plurality 

8 of images; and 

9 using the projection of the line in at least one of the other of the plurality of 
10 images to identify a corresponding point in that image. 

1 24. A method of identifying the location of a point in a three-dimensional space 

2 using two dimensional images which are substantially projections of a three- 

3 dimensional model, comprising the steps of: 

4 selecting a particular point on one of the two dimensional images; 

5 selecting the same point on at least one other of the two dimensional images; 

6 identifying the associated vertex on the model of the particular point on the 

7 images; 

8 determining the selected point location by interpolating between known 

9 locations of model vertices based on interpolation using pixel count 
10 between the particular point and one or more sets of adjacent vertices. 

1 25. The method of claim 24 in which distance between two points is determined 

2 by identifying the locations of the two points and determining line length using 

3 the coordinates determined for those points. 

1 26. A system for using patient image information, comprising: 

2 a computer configured to customize a generic three-dimensional model using 

3 patient specific information; 

4 a network linking the computer to a second computer; and 
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5 the second computer configured to receive the patient specific information 

6 and to customize a locally stored generic three-dimensional model using 

7 the patient information. 

1 27. A computer program product, comprising: 

2 a memory medium; and 

3 a computer program stored on the memory medium, the computer program 

4 comprising instructions for using corresponding points on different 

5 images of a patient to establish a common reference frame, the computer 

6 program further for determining the relative location of anatomical 

7 locations of the anatomy of the patient using the different images and the 

8 common reference frame. 

1 28. A computer program product, comprising: 

2 a memory medium; and 

3 a computer program stored on the memory medium, the computer program 

4 comprising instructions for identifying one or more anatomic location in a 

5 plurality of patient images from a particular patient imaging session, 

6 calculating anatomic location information in a common reference frame 

7 established from the plurality of images, and using the location 

8 information for patient treatment planning. 
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